-- Logs begin at Wed 2022-09-28 06:39:05 UTC, end at Wed 2022-09-28 07:44:23 UTC. -- Sep 28 07:15:27.259977 dv-cinder-859447-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 07:15:27.267593 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 07:15:27 2022] *** Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: nodename: dv-cinder-859447-1-iscsi Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: machine: x86_64 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: clock source: unix Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: pcre jit disabled Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: detected number of CPU cores: 4 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: current working directory: / Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: detected binary path: /usr/bin/uwsgi-core Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: your processes number limit is 47680 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: your memory page size is 4096 bytes Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: detected max file descriptor number: 2048 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: lock engine: pthread robust mutexes Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: thunder lock: enabled Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 07:15:27.272794 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 07:15:27.311566 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: Python main interpreter initialized at 0x5624b303b9c0 Sep 28 07:15:27.311566 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: python threads support enabled Sep 28 07:15:27.311566 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: your server socket listen backlog is limited to 100 connections Sep 28 07:15:27.311566 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: your mercy for graceful operations on workers is 90 seconds Sep 28 07:15:27.311929 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 07:15:27.312010 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: *** Operational MODE: preforking *** Sep 28 07:15:27.312235 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: *** uWSGI is running in multiple interpreter mode *** Sep 28 07:15:27.312235 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: spawned uWSGI master process (pid: 105473) Sep 28 07:15:27.312433 dv-cinder-859447-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 07:15:27.313296 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: spawned uWSGI worker 1 (pid: 105474, cores: 1) Sep 28 07:15:27.313397 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: spawned uWSGI worker 2 (pid: 105475, cores: 1) Sep 28 07:15:27.313478 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 07:15:27.972460 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 07:15:27.981364 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 07:15:29.066886 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:15:29.066886 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: from cryptography.utils import int_from_bytes Sep 28 07:15:29.067469 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:15:29.067469 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: from cryptography.utils import int_from_bytes Sep 28 07:15:29.068753 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:15:29.068753 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: from cryptography.utils import int_from_bytes Sep 28 07:15:29.069207 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:15:29.069207 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: from cryptography.utils import int_from_bytes Sep 28 07:15:31.551852 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 07:15:31.552447 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 07:15:31.552621 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 07:15:31.553010 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 07:15:31.553266 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 07:15:31.553650 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.553972 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.554291 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.554607 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.554931 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.555237 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.555551 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.555864 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.556186 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.556439 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.556751 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.557103 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-1-iscsi {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.557530 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.557838 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.558145 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.558458 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.558758 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.559077 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.559379 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.559873 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.560397 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.560971 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.561433 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.561585 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 07:15:31.561966 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.562057 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 07:15:31.562134 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.562239 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.562362 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 07:15:31.562546 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.562747 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 07:15:31.562968 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.563159 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 07:15:31.563399 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.563594 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.563784 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.564017 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.564212 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-1-iscsi {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.564420 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.564621 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.564829 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.565058 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.565267 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.565464 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.565634 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.565874 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.566084 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.566287 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.566463 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.566631 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.566767 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.566987 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.567124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.567313 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.567452 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.567604 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.567740 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-1-iscsi {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.567886 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568058 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568236 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568375 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568515 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568657 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568801 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.568939 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569101 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569245 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569421 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569569 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569709 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569844 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569978 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.569978 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.570235 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.570473 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.570617 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.570751 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.570910 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571054 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571188 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571327 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571470 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571611 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571761 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.571896 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572110 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572257 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572399 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572533 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572688 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572824 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.572824 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.573748 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.573892 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.574057 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.574298 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.574450 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-1-iscsi {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.574586 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.574746 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.574882 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575016 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575016 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575288 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575288 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575547 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575690 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575824 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.575965 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576105 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576248 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576392 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576527 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576660 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576794 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.576937 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577106 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577250 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577392 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577527 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577661 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577802 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.577947 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578088 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578223 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578357 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578646 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578789 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.578924 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579070 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579213 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579356 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579490 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579638 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579773 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.579906 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580039 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580171 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580318 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580463 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580597 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580736 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.580871 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581056 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581205 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581351 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581486 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581621 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581762 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.581907 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582054 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582207 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582342 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582476 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582616 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582760 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.582901 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583035 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583168 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583301 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583433 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583575 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583716 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583863 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.583996 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.584129 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.584271 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.584422 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.584557 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.584702 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.584841 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585001 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585151 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585300 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585443 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585576 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585719 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585852 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.585852 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586121 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586262 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586396 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586530 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586663 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586806 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.586940 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587073 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587212 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587362 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587516 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587668 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587802 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.587942 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.588091 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.588233 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.588366 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.589433 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.589742 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.589884 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590019 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590153 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590287 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590440 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590578 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590723 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590865 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.590999 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591140 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591285 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591420 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591555 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591688 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591822 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.591964 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592106 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592250 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592384 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592516 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592649 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592790 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.592925 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593098 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593234 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593368 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593510 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593659 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593794 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.593944 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594085 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594219 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594352 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594494 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594629 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594763 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.594896 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595029 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595241 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595379 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595533 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595670 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595815 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.595956 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596104 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596248 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596383 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596383 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596636 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596768 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.596911 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.597081 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.597217 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.597217 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.597490 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.597634 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.597780 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.597922 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.598062 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.598211 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.598345 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.598481 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.598622 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.598757 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.598891 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.599024 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.599169 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.599314 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.599457 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.599590 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.599723 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.599868 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.600012 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.600155 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.600290 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.600458 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.600607 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.600779 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.600920 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.601128 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.601276 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.601409 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.601543 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.601708 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.601849 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.602018 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.602170 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.602326 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.602467 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.602629 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.602770 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.602934 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.603086 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.603231 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.603371 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.603528 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.603683 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.603819 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.603952 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.604137 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.604334 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.604556 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.604706 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.604877 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.605062 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.605234 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.605386 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.605546 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.605707 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.605846 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.605998 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.606141 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.606277 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.606428 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.606572 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:15:31.606750 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.606892 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.607059 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.607223 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.607359 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.607502 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.607670 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.607953 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.608290 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.608447 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.608593 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.608740 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.608877 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609078 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609217 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609351 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609505 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609641 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609775 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.609916 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610051 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610191 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610338 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610475 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610616 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610750 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.610941 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611079 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611222 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611368 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611513 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611648 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611782 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.611915 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612061 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612197 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612338 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612473 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612608 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612754 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.612890 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613062 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613199 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613333 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613467 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613613 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613748 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.613914 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614065 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614206 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614340 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614528 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614672 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614813 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.614964 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.615139 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.615565 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.615714 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.615862 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616003 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616139 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616306 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616529 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616809 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.616986 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617129 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617285 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617434 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617570 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617704 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617847 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.617993 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.618129 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.618275 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.618411 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.618579 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.618736 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.618896 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.619046 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.619201 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.619337 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.619510 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.619659 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.619863 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.620004 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.620171 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.620478 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.620617 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.620787 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.620935 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.621218 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.621370 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.621506 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.621640 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.621774 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.621914 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622064 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622199 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622340 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622476 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622647 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622797 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.622941 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.623076 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.623259 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.623401 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.623583 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.623777 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.623922 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624065 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624200 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624334 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624468 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624610 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624745 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.624878 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625046 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625194 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625352 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625506 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625648 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625783 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.625943 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626084 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626236 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626380 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626515 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626678 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.626990 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.627157 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.627303 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.627438 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.627579 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.627715 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.627893 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.628047 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.628205 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.628354 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.628496 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.628632 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.628822 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629010 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629162 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629298 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629464 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629614 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629789 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.629944 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630080 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630215 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630393 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630545 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630690 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630840 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.630994 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.631137 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.631304 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.631454 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.631621 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.631771 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.631919 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.632054 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.632227 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.632368 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.632548 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.632690 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.632859 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633056 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633205 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633341 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633489 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633633 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633811 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.633955 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.634123 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.634272 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.634424 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.634561 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.634729 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.634871 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.635041 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.635192 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.635889 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.636058 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.636268 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.636427 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.636562 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.636707 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.636843 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637012 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637155 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637289 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637434 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637592 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637728 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.637862 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638003 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638137 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638280 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638424 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638558 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638692 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.638869 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639012 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639181 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639334 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639476 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639618 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639781 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.639923 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.640090 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.640233 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.640426 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.640566 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.640732 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.640873 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641083 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641223 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641367 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641502 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641667 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641815 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.641999 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.642150 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.642307 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.642456 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.642620 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.642770 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.642941 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643084 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643255 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643408 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643563 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643717 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643853 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.643997 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.644163 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.644305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.644465 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.644619 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.644755 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.644888 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.645095 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.645238 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.645406 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.645620 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.645758 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.645891 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646025 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646160 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646293 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646435 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646579 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646715 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.646874 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647016 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647167 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647316 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647451 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647627 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647776 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.647954 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.648108 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.648272 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.648413 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.648589 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.648731 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.648904 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.649120 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.649268 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.649402 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.649535 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.649668 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.649851 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650001 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650167 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650308 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650470 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650611 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.650888 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.651691 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.651853 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652021 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652164 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652337 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652481 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652678 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652827 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.652992 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.653133 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.653279 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.653414 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.653579 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.653721 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.653872 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654007 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654186 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654329 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654506 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654647 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654818 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.654973 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.655116 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.655250 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.655422 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.655572 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.655714 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.655868 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656029 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656171 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656339 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656487 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656654 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656804 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.656981 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.657123 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.657281 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.657422 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.657592 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.657755 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.657891 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.658024 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.658170 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.658305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.658487 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.658637 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.658778 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659051 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659199 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659384 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659539 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659682 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659837 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.659999 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.660155 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.660323 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.660477 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.660629 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.660779 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.660960 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.661109 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.661260 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.661402 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.661590 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.661739 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.661891 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662031 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662170 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662310 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662464 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662606 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662746 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.662887 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663050 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663198 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663353 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663496 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663643 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663801 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.663944 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664097 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664246 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664388 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664529 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664668 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664807 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.664984 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.665134 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.665274 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.665425 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.665577 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.665718 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.665871 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.666025 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.666167 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.666308 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.666448 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.666595 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.666907 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667053 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667209 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667466 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667558 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667652 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667800 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.667945 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.668102 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.668278 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.668441 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.668593 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.668740 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.668913 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.669104 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.669263 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.669428 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.669590 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.669755 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.669905 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.670047 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.670188 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.670338 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.670646 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.670802 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.670944 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671090 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671239 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671390 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671531 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671671 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.671962 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.672116 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.672266 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.672418 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.672605 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.672760 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.672938 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.673111 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.673280 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.673438 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.673580 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.673729 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.673870 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674010 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674209 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674362 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674505 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674646 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674786 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.674926 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675066 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675215 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675356 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675498 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675657 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.675940 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676088 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676237 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676378 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676522 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676661 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676810 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.676975 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.677124 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.677265 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.677406 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.677569 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.677720 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.677869 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678018 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678159 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678307 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678449 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678604 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678746 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.678886 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679026 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679167 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679314 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679483 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679627 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679781 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.679927 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680079 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680229 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680372 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680512 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680654 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680794 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.680935 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.681147 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.681300 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.681449 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.681589 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.681737 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.681879 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.682027 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.682169 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.682345 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.682497 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.682639 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.682789 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683068 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683215 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683366 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683516 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683657 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683805 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.683948 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.684088 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.684250 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.684406 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.684568 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.684719 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.684861 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.685027 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.685181 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.685333 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.685747 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.685903 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686046 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686186 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686327 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686467 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686616 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686758 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.686983 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.687129 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.687269 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.687410 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.687577 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.687733 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.687875 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688017 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688159 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688299 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688449 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688599 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688741 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.688882 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689059 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689205 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689366 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689515 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689657 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689804 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.689957 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.690100 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.690329 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.690477 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.690619 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.690759 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.690906 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691057 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691201 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691358 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691507 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691649 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691790 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.691939 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692087 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692230 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692370 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692510 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692650 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692804 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.692962 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693122 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693276 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693417 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693565 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693715 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693857 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.693997 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.694145 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.694292 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.694443 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.694586 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.694726 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.694866 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.695007 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.695162 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.695311 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.695454 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696004 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696153 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696153 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696431 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696431 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696710 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.696710 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.697013 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.697162 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.697316 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.697479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.697629 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.697771 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.698595 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.698753 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.698972 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.698972 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.699251 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.699251 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.699527 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.699670 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.699821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.699975 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.700116 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.700256 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.700415 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.700560 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.700868 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701035 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701181 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701321 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701462 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701614 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701766 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.701925 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.702068 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.702208 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.702357 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.702507 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.702657 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.702800 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.703071 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.703221 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.703654 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.703816 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.703978 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.704120 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.704276 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.704425 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.704581 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.704732 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.704732 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705072 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705219 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705361 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705510 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705653 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705794 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.705943 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706085 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706236 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706236 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706520 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706668 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706811 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.706952 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.707102 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.707244 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.707385 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709041 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709139 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709213 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709297 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709373 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709442 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709507 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709571 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709636 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709709 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709709 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709829 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709894 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.709966 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710038 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710180 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710245 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710310 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710376 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710449 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710524 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710592 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710680 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710747 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710819 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710895 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.710963 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711027 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711091 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711257 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711360 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711601 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711681 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711914 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.711993 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.712225 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.712312 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.712539 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.712628 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.712847 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.712938 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.713177 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.713365 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.713602 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.714260 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.714487 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.714643 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.714847 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.715007 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.715173 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.715324 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.715587 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.715781 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.715934 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.716102 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.716252 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.716395 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.716536 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.716676 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.716908 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717092 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717246 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717405 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717555 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717698 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717839 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.717997 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.718152 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.718303 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.718446 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.718587 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.718736 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.718886 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719046 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719189 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719330 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719472 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719613 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719761 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.719922 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720064 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720206 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720355 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720504 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720647 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720798 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.720969 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.721123 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.721264 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.721404 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.721580 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.721747 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.721902 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722051 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722192 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722370 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722530 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722680 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722822 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.722986 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.723134 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.723313 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.723476 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.723641 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.723790 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.723941 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.724081 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.724265 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.724421 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.724563 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.724710 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.724856 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725029 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725203 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725365 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725531 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725680 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725832 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.725973 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.726152 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.726307 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.726450 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.726591 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.726774 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.726931 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727082 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727223 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727372 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727513 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727685 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727843 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.727994 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.728144 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.728286 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.728427 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.728568 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.728717 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.728859 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.729065 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.729237 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.729474 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.729629 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.729782 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.729934 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730083 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730226 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730368 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730541 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730699 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730840 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.730982 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.731129 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.731271 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.731461 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.731619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.731856 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732003 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732146 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732294 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732445 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732587 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732735 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.732877 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733047 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733192 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733350 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733493 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733634 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733792 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.733934 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734076 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734230 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734373 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734514 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734655 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734795 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.734946 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.735098 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.735276 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.735423 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.735564 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.735718 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.735868 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736017 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736158 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736307 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736455 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736597 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736748 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.736890 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.737090 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.737233 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.737375 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.737542 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.737779 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.737924 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.738110 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.738260 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.738439 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.738588 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.738743 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.738886 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739048 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739197 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739340 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739490 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739650 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739793 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.739955 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.740110 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.740263 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.740415 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.740557 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.740698 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.740839 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741007 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741156 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741488 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741646 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741809 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.741958 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.742133 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.742291 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.742433 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.742583 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.742747 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.742896 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743046 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743189 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743329 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743479 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743623 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743771 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.743944 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.744101 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.744248 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.744389 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.744562 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.744721 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.744906 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.745080 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.745255 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.745475 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.745631 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.745783 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.745926 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.746098 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.746254 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.746404 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.746546 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.746700 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.746844 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747016 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747165 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747330 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747495 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747647 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747790 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.747930 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.748071 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.748234 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.748392 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.748541 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.748683 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.748877 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749089 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749235 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749395 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749537 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749685 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749826 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.749976 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.750125 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.750276 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.750491 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.750646 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.750813 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.750962 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.751245 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.751394 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.751554 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.751726 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.751884 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.751986 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.752201 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.752300 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.752520 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.752609 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.752850 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.752981 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.753184 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.753274 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.753494 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.753583 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.753807 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.753912 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.754113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.754202 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.754418 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.754506 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.754742 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.754872 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755052 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755148 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755356 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755457 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755675 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755784 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.755981 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.756082 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.756309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.756506 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.756629 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.756854 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.756963 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.757197 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.757321 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.757523 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.757643 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.757846 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.757943 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.758160 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.758265 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.758466 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.758564 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.758788 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.758875 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.759096 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.759182 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.759401 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.759496 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.759714 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.759801 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.760023 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.760111 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.760851 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.760990 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.761282 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.761381 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.761471 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.761604 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.761759 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.761942 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.762093 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.762235 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.762377 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.762565 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.762733 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.762886 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763028 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763192 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763342 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763503 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763648 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763831 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.763982 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.764133 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.764323 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.764482 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.764633 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.764776 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765004 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765155 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765297 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765451 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765617 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765765 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.765916 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766065 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766216 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766367 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766509 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766664 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766807 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.766995 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.767218 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.767363 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.767505 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.767647 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.767789 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.767940 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.768093 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.768236 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.768412 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.768565 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.768715 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.768858 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769041 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769190 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769339 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769482 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769631 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769790 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.769961 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.770106 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.770247 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.770440 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.770589 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.770761 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.770912 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.771089 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.771286 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.771442 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.771620 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.771780 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.771942 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.772091 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.772245 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.772395 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.772579 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.772742 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.772885 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773066 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773210 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773352 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773492 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773643 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773786 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.773937 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.774096 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.774297 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.774468 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.774616 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.774756 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.774897 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775039 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775188 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775344 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775487 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775629 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775770 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.775927 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.776618 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.776779 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.776922 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.777137 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.777286 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.777452 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.777613 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.777756 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.777897 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778046 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778198 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778351 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778506 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778649 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778791 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.778931 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.779073 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.779270 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.779432 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.779575 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.779717 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.779865 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780008 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780150 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780316 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780460 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780608 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780782 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.780930 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781120 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781263 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781405 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781546 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781694 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781844 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.781999 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.782142 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.782302 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.782457 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.782599 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.782740 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.782890 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.783039 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.783240 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.783555 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.783704 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.783871 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.784029 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.784201 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.784359 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.784509 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.784651 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.784830 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.785071 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.785227 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.785410 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.785562 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.785736 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.785895 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.786077 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.786227 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.786390 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.786532 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.786713 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.786870 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787021 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787163 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787446 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787633 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787790 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.787941 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.788084 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.788248 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.788405 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.788555 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.788707 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.788850 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789045 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789195 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789337 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789490 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789632 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789774 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.789915 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790056 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790206 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790358 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790500 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790648 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790798 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.790939 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791098 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791242 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791383 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791523 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791692 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791844 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.791996 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.792314 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.792467 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.792612 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.792764 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.792907 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793091 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793253 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793253 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793530 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793824 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.793974 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794116 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794271 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794412 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794552 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794702 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794845 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.794987 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.795128 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.795269 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.795417 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.795568 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.795711 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.795852 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796004 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796147 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796364 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796510 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796652 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796793 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.796992 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.797159 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.797315 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.797458 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.797630 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.797787 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.797962 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.798124 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.798275 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.798418 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.798596 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.798746 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.798923 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799071 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799222 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799372 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799521 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799663 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799805 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.799964 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.800107 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.800250 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.800400 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.800543 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.800683 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.800879 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.801054 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.801199 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.801352 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.801495 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.801643 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.801799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802003 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802163 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802307 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802449 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802600 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802754 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.802903 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803087 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803241 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803385 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803534 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803677 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803835 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.803979 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.804127 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.804271 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.804422 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.804564 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.804706 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.804856 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805036 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805197 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805340 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805491 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805641 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805794 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.805942 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806097 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806240 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806381 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806523 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806670 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806812 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.806962 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.807104 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.807767 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.807926 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808070 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808221 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808372 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808550 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808694 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.808999 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.809165 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.809309 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.809450 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.809592 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.809734 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.809882 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.810069 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.810222 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.810387 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.810799 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.810942 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.811090 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.811246 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 07:15:31.811390 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.811590 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.811901 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.812224 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.812550 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.812873 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.813209 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.813547 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.813861 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.814177 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.814495 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.814806 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.815117 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.815431 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.815759 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.816088 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.816398 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.816720 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.817064 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.817391 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.817710 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.818026 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.818361 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.818675 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.818991 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.819309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.819625 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.819939 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.820260 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.820575 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.820889 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.821235 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.821555 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.821885 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.822215 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.822529 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.822886 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.823861 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.824223 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.824544 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.824894 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.825256 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.825578 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.825896 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.826209 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:15:31.826457 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 07:15:31.963385 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Registered counter for database nova_api Sep 28 07:15:31.978946 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Registered counter for database nova_api Sep 28 07:15:31.983336 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:31.989860 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:31.999474 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.005972 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.046830 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.context [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48cd990f-efc9-4822-a4b6-c05c4d52ec78(cell1) {{(pid=105475) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 07:15:32.050748 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:15:32.051224 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:15:32.052820 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:15:32.053525 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:15:32.053970 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:15:32.055935 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_concurrency.lockutils [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:15:32.058632 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Registered counter for database nova_cell0 Sep 28 07:15:32.062895 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Registered counter for database nova_cell1 Sep 28 07:15:32.063365 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.context [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48cd990f-efc9-4822-a4b6-c05c4d52ec78(cell1) {{(pid=105474) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 07:15:32.067333 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:15:32.067808 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:15:32.069597 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:15:32.070230 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.070336 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:15:32.070890 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:15:32.072368 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.072821 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:15:32.075541 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Registered counter for database nova_cell0 Sep 28 07:15:32.077999 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.079616 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Registered counter for database nova_cell1 Sep 28 07:15:32.080649 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.086567 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.091139 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.091768 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.222720 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO dbcounter [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Registered counter for database nova_cell0 Sep 28 07:15:32.231176 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.232134 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.236741 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writer thread running {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.239832 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Registered counter for database nova_cell0 Sep 28 07:15:32.249335 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:15:32.253904 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:15:32.576166 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:15:32.576798 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:15:32.583485 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:15:32.583976 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:15:32.926622 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:15:32.932493 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:15:32.933119 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:15:32.937963 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5624b303b9c0 pid: 105474 (default app) Sep 28 07:15:32.939318 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: WARNING keystonemiddleware.auth_token [None req-d9a3befe-8cc1-4377-b3e6-af9725f2d273 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:15:32.940026 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:15:32.941243 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Sep 28 07:15:32.941659 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Sep 28 07:15:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:15:32.944742 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5624b303b9c0 pid: 105475 (default app) Sep 28 07:16:54.750215 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:16:54.751242 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 28 07:16:54.751648 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:16:54.768442 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:54.769444 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell0:SELECT=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:54.770407 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell1:SELECT=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:54.771395 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:55.651620 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-a7988af4-62d4-4b9f-b243-e35495c01338 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:16:55.684338 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-a7988af4-62d4-4b9f-b243-e35495c01338 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925985 Sep 28 07:16:55.685252 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 07:16:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:16:58.354441 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:16:58.355436 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8019cfe3-083b-4484-8b2a-996d6b67821a None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Sep 28 07:16:58.356002 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:16:58.799420 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f4d5fce2-55f2-4388-995e-754ffdb68fbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "ram": 256, "name": "cirros256", "swap": 0, "vcpus": 1}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:16:58.848367 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f4d5fce2-55f2-4388-995e-754ffdb68fbe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486104 Sep 28 07:16:58.848919 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:16:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:16:58.863410 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:58.864881 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell0:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:58.865671 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell1:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:58.866427 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell0:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:16:59.074681 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-ecc880cb-3370-473b-a7de-58e2c97fc693 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:16:59.147971 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-ecc880cb-3370-473b-a7de-58e2c97fc693 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290215 Sep 28 07:16:59.148729 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 07:16:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:01.801403 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f4d5fce2-55f2-4388-995e-754ffdb68fbe admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:01.802429 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f4d5fce2-55f2-4388-995e-754ffdb68fbe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 28 07:17:01.803126 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:02.458558 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-c5a15cfe-5331-49dc-91d0-9d7541b4e2a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:02.505346 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-c5a15cfe-5331-49dc-91d0-9d7541b4e2a5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.695557 Sep 28 07:17:02.506229 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:02.519688 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-2f9db1ab-4591-4ead-b441-314bb215aac1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:02.567016 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-2f9db1ab-4591-4ead-b441-314bb215aac1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052701 Sep 28 07:17:02.568218 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 07:17:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:17:05.186795 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-c5a15cfe-5331-49dc-91d0-9d7541b4e2a5 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:05.187819 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-c5a15cfe-5331-49dc-91d0-9d7541b4e2a5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 28 07:17:05.188477 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:05.611771 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-17d0f811-662a-4d89-a57f-e918c34b5d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:05.632567 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-17d0f811-662a-4d89-a57f-e918c34b5d8f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436879 Sep 28 07:17:05.633150 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:17:05.645813 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-ffc27f48-e3bc-4e3a-b9dd-a8e52de47037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:05.674466 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-ffc27f48-e3bc-4e3a-b9dd-a8e52de47037 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032284 Sep 28 07:17:05.675210 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 07:17:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:08.281424 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-17d0f811-662a-4d89-a57f-e918c34b5d8f admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:08.282651 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-17d0f811-662a-4d89-a57f-e918c34b5d8f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Sep 28 07:17:08.283355 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:08.715908 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-62bb7510-f540-43db-96de-6c2feee71653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:08.735386 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-62bb7510-f540-43db-96de-6c2feee71653 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445717 Sep 28 07:17:08.736151 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:17:08.749111 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f77a0edd-df27-4d65-8c37-c4a3b339c61b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:08.778446 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f77a0edd-df27-4d65-8c37-c4a3b339c61b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032896 Sep 28 07:17:08.779022 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 07:17:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:11.518049 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-62bb7510-f540-43db-96de-6c2feee71653 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:11.519462 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-62bb7510-f540-43db-96de-6c2feee71653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Sep 28 07:17:11.520056 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:11.942392 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-6ed42b53-97cd-4738-b56f-07bdcacf347b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:11.961218 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-6ed42b53-97cd-4738-b56f-07bdcacf347b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433420 Sep 28 07:17:11.961771 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:11.975911 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-5532ffe6-1a23-4a71-9e3b-1436529190e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:12.006762 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-5532ffe6-1a23-4a71-9e3b-1436529190e6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035733 Sep 28 07:17:12.007430 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 07:17:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:15.282338 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-6ed42b53-97cd-4738-b56f-07bdcacf347b admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:15.283674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-6ed42b53-97cd-4738-b56f-07bdcacf347b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Sep 28 07:17:15.284161 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:15.724312 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-d09b5404-e036-4420-929e-2dd01db39abc admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:15.755805 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-d09b5404-e036-4420-929e-2dd01db39abc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465057 Sep 28 07:17:15.756648 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 07:17:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:18.405317 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-6ed42b53-97cd-4738-b56f-07bdcacf347b admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:18.406328 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-6ed42b53-97cd-4738-b56f-07bdcacf347b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Sep 28 07:17:18.406726 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:18.801288 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-47c90f33-d71c-4a0b-a122-1a814505b6a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "swap": 0, "id": "1", "name": "m1.tiny"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:18.823071 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-47c90f33-d71c-4a0b-a122-1a814505b6a0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.409799 Sep 28 07:17:18.823810 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:18.835657 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-b0628013-722f-44fc-9c62-4bb73d2fc3f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:18.862347 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-b0628013-722f-44fc-9c62-4bb73d2fc3f3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030268 Sep 28 07:17:18.862922 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 07:17:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:21.471464 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-47c90f33-d71c-4a0b-a122-1a814505b6a0 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:21.472386 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-47c90f33-d71c-4a0b-a122-1a814505b6a0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 28 07:17:21.472783 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:21.893401 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-e528df98-3ad3-4d59-b70a-0b13131dcd97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:21.913127 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-e528df98-3ad3-4d59-b70a-0b13131dcd97 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433682 Sep 28 07:17:21.913791 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:21.929288 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-e1d86cce-1d37-4a61-b8d4-bc60647ae099 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:21.955879 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-e1d86cce-1d37-4a61-b8d4-bc60647ae099 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030290 Sep 28 07:17:21.956556 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 07:17:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:17:24.610432 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-e528df98-3ad3-4d59-b70a-0b13131dcd97 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:24.611450 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-e528df98-3ad3-4d59-b70a-0b13131dcd97 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 28 07:17:24.611881 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:25.058590 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-04856a81-9f60-4789-81b8-cf22c7754933 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:25.091409 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-04856a81-9f60-4789-81b8-cf22c7754933 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.473119 Sep 28 07:17:25.091969 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:25.104618 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-f648e318-a09d-442d-afda-b0fe50d457a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:25.110900 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:17:25.135878 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-f648e318-a09d-442d-afda-b0fe50d457a5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035499 Sep 28 07:17:25.136559 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 07:17:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:27.770613 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-04856a81-9f60-4789-81b8-cf22c7754933 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:27.771620 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-04856a81-9f60-4789-81b8-cf22c7754933 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 28 07:17:27.772202 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:28.204304 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c729b90f-8d54-4280-bba3-43aa35f97a9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:28.224353 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-c729b90f-8d54-4280-bba3-43aa35f97a9a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445259 Sep 28 07:17:28.225005 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:28.237261 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-2f72d7a9-0ca4-4494-b158-7a66e612099c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:28.263083 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-2f72d7a9-0ca4-4494-b158-7a66e612099c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029394 Sep 28 07:17:28.263937 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 07:17:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:17:30.884545 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c729b90f-8d54-4280-bba3-43aa35f97a9a admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:30.885598 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-c729b90f-8d54-4280-bba3-43aa35f97a9a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Sep 28 07:17:30.886006 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:31.343680 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-0f2c2f67-22cd-4fe1-b0b7-8bd5a52de30d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "id": "5", "disk": 160, "vcpus": 8}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:31.353302 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:17:31.369266 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-0f2c2f67-22cd-4fe1-b0b7-8bd5a52de30d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477252 Sep 28 07:17:31.369917 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 07:17:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:17:31.381848 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-cc1047e0-9f0a-43e5-8154-17ce3a96193d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:31.409196 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-cc1047e0-9f0a-43e5-8154-17ce3a96193d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030924 Sep 28 07:17:31.409696 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 07:17:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:17:47.805982 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-0f2c2f67-22cd-4fe1-b0b7-8bd5a52de30d admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:47.806990 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-0f2c2f67-22cd-4fe1-b0b7-8bd5a52de30d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 28 07:17:47.807381 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:17:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:47.818107 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:17:48.194416 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-365cd861-136d-41b5-b29e-22f02dc61552 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:48.212583 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-365cd861-136d-41b5-b29e-22f02dc61552 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399000 Sep 28 07:17:48.213143 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 07:17:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:49.517214 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-0f2c2f67-22cd-4fe1-b0b7-8bd5a52de30d admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:49.518217 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-0f2c2f67-22cd-4fe1-b0b7-8bd5a52de30d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 28 07:17:49.518611 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:50.038668 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-67649c42-deac-43c7-87a2-1cbbd8d45530 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:50.043831 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.wsgi [None req-67649c42-deac-43c7-87a2-1cbbd8d45530 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-67649c42-deac-43c7-87a2-1cbbd8d45530 admin admin] Request method failure captured: Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Accept: application/json Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Accept-Encoding: gzip, deflate Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Connection: keep-alive Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Content-Length: 0 Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Host: 10.222.0.52 Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Openstack-Api-Version: compute 2.92 Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Openstack-System-Scope: None Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: User-Agent: python-novaclient Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Auth-Token: gAAAAABjM_UdFTU5zPUG46OrKCB714-AXpVD8E0FK20GFRzofgPr1PSe2t-wVIlRDbWKhqMjkyRe_5_oDYLzDHNgnCW5h1vGrV79647RzZVsxwBRA6gDGkj_ruk9vof6-CKa_YWq0BsJV5yL4GvqZC1fdPy27oXbPKokkh9J1z5EkoVJxFBGgUI Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Domain-Id: None Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Domain-Name: None Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Identity-Status: Confirmed Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Is-Admin-Project: True Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Domain-Id: default Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Domain-Name: Default Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Name: admin Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Role: member,reader,admin Sep 28 07:17:50.047113 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Roles: member,reader,admin Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_712d7cadf2c0478da279cd0f1a4dd259", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant: admin Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant-Name: admin Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User: admin Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Domain-Id: default Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Domain-Name: Default Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Id: 955dc67368494986a8ad78d63a857238 Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Name: admin Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: method: > Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: exception: Flavor 42 could not be found. Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: action_args: {'id': '42'} Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:17:50.048753 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:50.049821 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.051221 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-67649c42-deac-43c7-87a2-1cbbd8d45530 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:17:50.052463 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-67649c42-deac-43c7-87a2-1cbbd8d45530 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393618 Sep 28 07:17:50.052463 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 07:17:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 07:17:50.058884 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-9d64b9ee-2871-4f68-922b-c9e056a6ecde admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:50.082865 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-9d64b9ee-2871-4f68-922b-c9e056a6ecde admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027487 Sep 28 07:17:50.083405 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 07:17:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:50.093998 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-78288382-6e0c-4c92-8efc-38c7e2cc5165 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:50.117031 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-78288382-6e0c-4c92-8efc-38c7e2cc5165 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026768 Sep 28 07:17:50.117597 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 07:17:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:50.127061 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-484e65b9-4ab2-417c-af81-ec87cb3bfa12 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:50.133053 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.wsgi [None req-484e65b9-4ab2-417c-af81-ec87cb3bfa12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-484e65b9-4ab2-417c-af81-ec87cb3bfa12 admin admin] Request method failure captured: Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Accept: application/json Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Accept-Encoding: gzip, deflate Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Connection: keep-alive Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Content-Length: 0 Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Host: 10.222.0.52 Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Openstack-Api-Version: compute 2.92 Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Openstack-System-Scope: None Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: User-Agent: python-novaclient Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Auth-Token: gAAAAABjM_UdFTU5zPUG46OrKCB714-AXpVD8E0FK20GFRzofgPr1PSe2t-wVIlRDbWKhqMjkyRe_5_oDYLzDHNgnCW5h1vGrV79647RzZVsxwBRA6gDGkj_ruk9vof6-CKa_YWq0BsJV5yL4GvqZC1fdPy27oXbPKokkh9J1z5EkoVJxFBGgUI Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Domain-Id: None Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Domain-Name: None Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Identity-Status: Confirmed Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Is-Admin-Project: True Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Domain-Id: default Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Domain-Name: Default Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Name: admin Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Role: member,reader,admin Sep 28 07:17:50.136305 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Roles: member,reader,admin Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_712d7cadf2c0478da279cd0f1a4dd259", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant: admin Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant-Name: admin Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User: admin Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Domain-Id: default Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Domain-Name: Default Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Id: 955dc67368494986a8ad78d63a857238 Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Name: admin Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: method: > Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: exception: Flavor 42 could not be found. Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: action_args: {'id': '42'} Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:17:50.137744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:50.138533 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:50.139582 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-484e65b9-4ab2-417c-af81-ec87cb3bfa12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:17:50.140836 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-484e65b9-4ab2-417c-af81-ec87cb3bfa12 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014297 Sep 28 07:17:50.140836 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 07:17:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 07:17:51.356520 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-78288382-6e0c-4c92-8efc-38c7e2cc5165 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:51.357567 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-78288382-6e0c-4c92-8efc-38c7e2cc5165 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 28 07:17:51.357966 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:51.896752 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-760d8b23-5d99-40b8-b27d-dd6e1bd496c1 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:51.901786 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.wsgi [None req-760d8b23-5d99-40b8-b27d-dd6e1bd496c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-760d8b23-5d99-40b8-b27d-dd6e1bd496c1 admin admin] Request method failure captured: Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Accept: application/json Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Accept-Encoding: gzip, deflate Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Connection: keep-alive Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Content-Length: 0 Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Host: 10.222.0.52 Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Openstack-Api-Version: compute 2.92 Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Openstack-System-Scope: None Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: User-Agent: python-novaclient Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Auth-Token: gAAAAABjM_UfyRgEne_hxCadPewGDJoP-uCuZczfRjcHvUmsbt-cvhzt4ox4BFvQP-cKEgkiHXamOl3-OiZp8Iu0qUHeoNqrLNeIGSRnrQxpgWnsQ3HSiBRddl_aoo0MwvYCFZzpqq2O54Ig1tC3h1UT4Db4tkKICUX5lzkDJc1y4f9LI_CgEkk Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Domain-Id: None Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Domain-Name: None Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Identity-Status: Confirmed Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Is-Admin-Project: True Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Domain-Id: default Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Domain-Name: Default Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Name: admin Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Role: member,reader,admin Sep 28 07:17:51.903279 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Roles: member,reader,admin Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_712d7cadf2c0478da279cd0f1a4dd259", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant: admin Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant-Name: admin Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User: admin Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Domain-Id: default Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Domain-Name: Default Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Id: 955dc67368494986a8ad78d63a857238 Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Name: admin Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: method: > Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: exception: Flavor 84 could not be found. Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: action_args: {'id': '84'} Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:17:51.904799 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:51.905835 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.907124 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-760d8b23-5d99-40b8-b27d-dd6e1bd496c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:17:51.908141 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-760d8b23-5d99-40b8-b27d-dd6e1bd496c1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.410069 Sep 28 07:17:51.908141 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 07:17:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 07:17:51.916247 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-2ff1db4a-c6e5-4cfe-b752-dbe95d59e5e5 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:51.931630 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-2ff1db4a-c6e5-4cfe-b752-dbe95d59e5e5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019540 Sep 28 07:17:51.932177 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 07:17:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:17:51.941744 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8b3574fb-3e8f-4700-9b75-e895fda7b29f admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:51.956839 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8b3574fb-3e8f-4700-9b75-e895fda7b29f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018646 Sep 28 07:17:51.957378 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 07:17:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:51.966482 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c0130eea-2e13-482d-9a44-b65bc14ca07c admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:51.971644 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.wsgi [None req-c0130eea-2e13-482d-9a44-b65bc14ca07c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c0130eea-2e13-482d-9a44-b65bc14ca07c admin admin] Request method failure captured: Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Accept: application/json Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Accept-Encoding: gzip, deflate Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Connection: keep-alive Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Content-Length: 0 Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Host: 10.222.0.52 Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Openstack-Api-Version: compute 2.92 Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Openstack-System-Scope: None Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: User-Agent: python-novaclient Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Auth-Token: gAAAAABjM_UfyRgEne_hxCadPewGDJoP-uCuZczfRjcHvUmsbt-cvhzt4ox4BFvQP-cKEgkiHXamOl3-OiZp8Iu0qUHeoNqrLNeIGSRnrQxpgWnsQ3HSiBRddl_aoo0MwvYCFZzpqq2O54Ig1tC3h1UT4Db4tkKICUX5lzkDJc1y4f9LI_CgEkk Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Domain-Id: None Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Domain-Name: None Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Identity-Status: Confirmed Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Is-Admin-Project: True Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Domain-Id: default Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Domain-Name: Default Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Name: admin Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Role: member,reader,admin Sep 28 07:17:51.973190 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Roles: member,reader,admin Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_712d7cadf2c0478da279cd0f1a4dd259", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant: admin Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant-Name: admin Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User: admin Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Domain-Id: default Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Domain-Name: Default Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Id: 955dc67368494986a8ad78d63a857238 Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Name: admin Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: method: > Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: exception: Flavor 84 could not be found. Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: action_args: {'id': '84'} Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:17:51.974619 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:51.975956 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:51.977495 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-c0130eea-2e13-482d-9a44-b65bc14ca07c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:17:51.978701 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-c0130eea-2e13-482d-9a44-b65bc14ca07c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011692 Sep 28 07:17:51.978701 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 07:17:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 07:17:53.234960 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8b3574fb-3e8f-4700-9b75-e895fda7b29f admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:53.235963 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8b3574fb-3e8f-4700-9b75-e895fda7b29f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 28 07:17:53.236394 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:53.763287 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3020c0d7-2716-425c-9180-695dff1e8f20 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:53.769171 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.wsgi [None req-3020c0d7-2716-425c-9180-695dff1e8f20 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3020c0d7-2716-425c-9180-695dff1e8f20 admin admin] Request method failure captured: Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Accept: application/json Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Accept-Encoding: gzip, deflate Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Connection: keep-alive Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Content-Length: 0 Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Host: 10.222.0.52 Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Openstack-Api-Version: compute 2.92 Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Openstack-System-Scope: None Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: User-Agent: python-novaclient Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Auth-Token: gAAAAABjM_UhKZA-gy8QAI-Xlz6c51sZeSGQrZxD-fomVOocqXJfR3AiAbirFlmEBVlyKDCe6tymRqr0M_CeYmmCdmQicJiOZ-WUy0kiC0Vxz9D3Rfkxu3_gH9nt9QhOo9bRsjIS4jW8X3cnyOi-7S75ysFcFH8jj9aHlnvve56VK4W9xdgpH3s Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Domain-Id: None Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Domain-Name: None Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Identity-Status: Confirmed Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Is-Admin-Project: True Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Domain-Id: default Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Domain-Name: Default Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Project-Name: admin Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Role: member,reader,admin Sep 28 07:17:53.770674 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Roles: member,reader,admin Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_712d7cadf2c0478da279cd0f1a4dd259", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant: admin Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-Tenant-Name: admin Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User: admin Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Domain-Id: default Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Domain-Name: Default Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Id: 955dc67368494986a8ad78d63a857238 Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: X-User-Name: admin Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: method: > Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: exception: Flavor 451 could not be found. Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: action_args: {'id': '451'} Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:17:53.772673 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:53.773665 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.775092 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-3020c0d7-2716-425c-9180-695dff1e8f20 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:17:53.776310 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-3020c0d7-2716-425c-9180-695dff1e8f20 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394187 Sep 28 07:17:53.776310 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 07:17:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 07:17:53.782608 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-a9316cd7-ac2e-4ee6-b52a-d23300dc2a03 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:53.798723 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-a9316cd7-ac2e-4ee6-b52a-d23300dc2a03 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019695 Sep 28 07:17:53.799296 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 07:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:53.808595 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:53.824186 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019017 Sep 28 07:17:53.824781 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 07:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:17:53.836749 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-482409e8-95cc-42d7-b8a0-9d60393bcf3e admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:53.841785 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.wsgi [None req-482409e8-95cc-42d7-b8a0-9d60393bcf3e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-482409e8-95cc-42d7-b8a0-9d60393bcf3e admin admin] Request method failure captured: Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Accept: application/json Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Accept-Encoding: gzip, deflate Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Connection: keep-alive Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Content-Length: 0 Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Host: 10.222.0.52 Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Openstack-Api-Version: compute 2.92 Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Openstack-System-Scope: None Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: User-Agent: python-novaclient Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Auth-Token: gAAAAABjM_UhKZA-gy8QAI-Xlz6c51sZeSGQrZxD-fomVOocqXJfR3AiAbirFlmEBVlyKDCe6tymRqr0M_CeYmmCdmQicJiOZ-WUy0kiC0Vxz9D3Rfkxu3_gH9nt9QhOo9bRsjIS4jW8X3cnyOi-7S75ysFcFH8jj9aHlnvve56VK4W9xdgpH3s Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Domain-Id: None Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Domain-Name: None Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Identity-Status: Confirmed Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Is-Admin-Project: True Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Domain-Id: default Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Domain-Name: Default Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Project-Name: admin Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Role: member,reader,admin Sep 28 07:17:53.843309 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Roles: member,reader,admin Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/712d7cadf2c0478da279cd0f1a4dd259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_712d7cadf2c0478da279cd0f1a4dd259", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant: admin Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant-Id: 712d7cadf2c0478da279cd0f1a4dd259 Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-Tenant-Name: admin Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User: admin Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Domain-Id: default Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Domain-Name: Default Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Id: 955dc67368494986a8ad78d63a857238 Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: X-User-Name: admin Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: method: > Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: exception: Flavor 451 could not be found. Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: action_args: {'id': '451'} Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:17:53.846479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:53.848419 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Sep 28 07:17:53.851437 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-482409e8-95cc-42d7-b8a0-9d60393bcf3e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:17:53.854059 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-482409e8-95cc-42d7-b8a0-9d60393bcf3e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013402 Sep 28 07:17:53.854059 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 07:17:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 07:17:55.074690 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:55.075738 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 28 07:17:55.076135 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:55.599067 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-7a5c8611-e25f-4414-b5e9-c41019ffa6d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:55.619222 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-7a5c8611-e25f-4414-b5e9-c41019ffa6d6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405527 Sep 28 07:17:55.619759 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 07:17:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:17:56.870485 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:56.871515 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 28 07:17:56.871907 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:57.392519 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-9f9c5d15-bea3-4dd9-bc20-357db41db030 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:57.411374 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-9f9c5d15-bea3-4dd9-bc20-357db41db030 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401829 Sep 28 07:17:57.411908 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 07:17:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:17:58.632086 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:17:58.633137 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 28 07:17:58.633538 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:17:59.154348 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8a2af391-a3d9-478e-9f8b-ce72e28de8f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:17:59.173351 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8a2af391-a3d9-478e-9f8b-ce72e28de8f4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399553 Sep 28 07:17:59.173881 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 07:17:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:18:00.390247 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:00.391264 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 28 07:18:00.391660 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:18:00.917882 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-84a147bd-cd5b-444e-b9c8-ad757b37fce0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:18:00.937382 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-84a147bd-cd5b-444e-b9c8-ad757b37fce0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401736 Sep 28 07:18:00.937877 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 07:18:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:18:02.147687 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:02.148700 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Sep 28 07:18:02.149173 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:18:02.663352 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-74433c01-648c-4d21-9cf1-120d86575228 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:02.684290 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-74433c01-648c-4d21-9cf1-120d86575228 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400057 Sep 28 07:18:02.684832 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Sep 28 07:18:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:18:59.327919 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:59.329379 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-71b3ec50-561f-40af-97a7-8d48f9483b81 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Sep 28 07:18:59.329810 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 07:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:18:59.340479 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:18:59.719524 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-2fed0c86-8ceb-46f4-ae7a-8ef130660fdb admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:59.740334 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-2fed0c86-8ceb-46f4-ae7a-8ef130660fdb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404325 Sep 28 07:18:59.741225 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 07:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:18:59.761841 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=14 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:18:59.766085 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-6d85c442-8d51-4681-890c-4444e80f2156 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:59.774133 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-6d85c442-8d51-4681-890c-4444e80f2156 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013695 Sep 28 07:18:59.774678 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Sep 28 07:18:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:18:59.786647 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-0247f156-c4bd-49f5-a80e-42025a129ae2 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:59.793870 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-0247f156-c4bd-49f5-a80e-42025a129ae2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011418 Sep 28 07:18:59.794368 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Sep 28 07:18:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:18:59.805611 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:59.812992 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010928 Sep 28 07:18:59.813499 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Sep 28 07:18:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:18:59.824516 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-33e60940-d308-41a4-afdb-e458f3e66b5d admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:18:59.831548 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-33e60940-d308-41a4-afdb-e458f3e66b5d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010508 Sep 28 07:18:59.832566 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Sep 28 07:18:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:21:58.619968 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:21:58.621503 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 28 07:21:58.621910 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:21:58.768531 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=6 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:21:58.925729 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:21:58.930673 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:21:58.931150 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:21:58.931590 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:21:58.932306 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:21:58.932757 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:21:58.933210 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:21:58.963630 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-d4121229-d08c-4052-bc35-c18521f56873 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196174 Sep 28 07:21:58.964108 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 07:21:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:22:00.048119 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:22:00.049168 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 28 07:22:00.049575 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:22:00.244352 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:22:00.247853 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:22:00.248332 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:22:00.248757 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:22:00.249504 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:22:00.249954 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:22:00.250368 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:22:00.274584 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-3f63b34c-cd4b-4260-842a-590e8ec32f74 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.082235 Sep 28 07:22:00.275055 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 07:22:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:22:11.759347 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:22:11.760352 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 28 07:22:11.760742 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:22:11.903740 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell0:SELECT=4 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:22:11.904453 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell1:SELECT=4 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:22:11.905151 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=8 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:22:11.953891 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:22:11.957172 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:22:11.957648 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:22:11.958074 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:22:11.958790 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:22:11.959234 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:22:11.959649 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:22:11.983789 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-12825095-fa31-4918-bf74-fd5833d31450 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084496 Sep 28 07:22:11.984330 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 07:22:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:22:13.056249 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG nova.api.openstack.wsgi [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] Calling method '>' {{(pid=105475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:22:13.057298 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: INFO nova.api.openstack.requestlog [None req-ad94d7d2-778d-41a1-837b-ea3887bfd7b6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 28 07:22:13.057706 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: [pid: 105475|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 07:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:22:13.247091 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:22:13.250581 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:22:13.251065 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:22:13.251505 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:22:13.252234 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:22:13.252693 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:22:13.253160 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:22:13.274504 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-26c327f6-0428-4f3a-b7a3-9c43be26c29b admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077934 Sep 28 07:22:13.274985 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 07:22:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:23:12.417067 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: Wed Sep 28 07:23:12 2022 - graceful shutdown triggered... Sep 28 07:23:12.416791 dv-cinder-859447-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 28 07:23:12.418027 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: Gracefully killing worker 2 (pid: 105475)... Sep 28 07:23:12.418397 dv-cinder-859447-1-iscsi devstack@n-api.service[105474]: Gracefully killing worker 1 (pid: 105474)... Sep 28 07:23:12.544604 dv-cinder-859447-1-iscsi devstack@n-api.service[105475]: DEBUG dbcounter [-] [105475] Writing DB stats nova_api:SELECT=4 {{(pid=105475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:13.417215 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: worker 1 buried after 1 seconds Sep 28 07:23:13.417215 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: worker 2 buried after 1 seconds Sep 28 07:23:13.417849 dv-cinder-859447-1-iscsi devstack@n-api.service[105473]: goodbye to uWSGI. Sep 28 07:23:13.418780 dv-cinder-859447-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 28 07:23:13.419332 dv-cinder-859447-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 28 07:23:13.422815 dv-cinder-859447-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 07:23:13.432466 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 07:23:13 2022] *** Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: nodename: dv-cinder-859447-1-iscsi Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: machine: x86_64 Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: clock source: unix Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: pcre jit disabled Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: detected number of CPU cores: 4 Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: current working directory: / Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: detected binary path: /usr/bin/uwsgi-core Sep 28 07:23:13.434591 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: your processes number limit is 47680 Sep 28 07:23:13.435445 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: your memory page size is 4096 bytes Sep 28 07:23:13.435445 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: detected max file descriptor number: 2048 Sep 28 07:23:13.435445 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: lock engine: pthread robust mutexes Sep 28 07:23:13.435445 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: thunder lock: enabled Sep 28 07:23:13.435445 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 07:23:13.435445 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 07:23:13.475573 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: Python main interpreter initialized at 0x5588a514e9c0 Sep 28 07:23:13.475573 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: python threads support enabled Sep 28 07:23:13.475573 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: your server socket listen backlog is limited to 100 connections Sep 28 07:23:13.475573 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: your mercy for graceful operations on workers is 90 seconds Sep 28 07:23:13.475952 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 07:23:13.476022 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: *** Operational MODE: preforking *** Sep 28 07:23:13.501192 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: *** uWSGI is running in multiple interpreter mode *** Sep 28 07:23:13.501192 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: spawned uWSGI master process (pid: 120433) Sep 28 07:23:13.501192 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: spawned uWSGI worker 1 (pid: 120451, cores: 1) Sep 28 07:23:13.501192 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: spawned uWSGI worker 2 (pid: 120452, cores: 1) Sep 28 07:23:13.501192 dv-cinder-859447-1-iscsi devstack@n-api.service[120433]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 07:23:13.476477 dv-cinder-859447-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 07:23:14.150600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 07:23:14.174926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 07:23:15.328525 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:23:15.328525 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: from cryptography.utils import int_from_bytes Sep 28 07:23:15.329250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:23:15.329250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: from cryptography.utils import int_from_bytes Sep 28 07:23:15.330148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:23:15.330148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: from cryptography.utils import int_from_bytes Sep 28 07:23:15.330634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 07:23:15.330634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: from cryptography.utils import int_from_bytes Sep 28 07:23:17.739137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 07:23:17.739701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 07:23:17.740292 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 07:23:17.740292 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 07:23:17.740645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 07:23:17.740929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.741281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.741854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.741960 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.742251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.742564 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.742890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.743213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.743547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.743821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.744128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.744614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-1-iscsi {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.744981 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.745304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.745620 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.745935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.746249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.746425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 07:23:17.746862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.746953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 07:23:17.747034 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.747213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 07:23:17.747383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.747579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 07:23:17.748129 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.748447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.749494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 07:23:17.749750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.749978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.750227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.750451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.750670 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.750895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.751118 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.751340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.751577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.751799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.752007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.752238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.752446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.752669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.752880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.753101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.753101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.754727 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-1-iscsi {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.754839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.754917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.754990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-1-iscsi {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.755983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756060 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756142 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756601 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.756899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.757208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.757325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.757416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.757496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.757732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.757990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.758178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.758342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.758342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.758666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.758832 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.758997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.759155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.759310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.759455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.759607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.759777 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.759936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-1-iscsi {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.760082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.760229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.760382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.760543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.760701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.760867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.761961 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.762114 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.762274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.762419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.762574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.762738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.762884 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.763037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.763195 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.763352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.763714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.763877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.764033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.764287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.764922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.765099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.765245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.765440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.765776 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.765776 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.766257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.766425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.766425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.766819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.766819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.767118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.767118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.767401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.767553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.767699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.767862 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768020 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768324 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768479 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.768983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.769148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.769296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.769447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.769602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.769772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.769927 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770080 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.770980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.771131 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.771284 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.771441 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.771597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.771741 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.771885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772483 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.772938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.773230 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.773391 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.773561 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.773878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.774041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.774355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.774535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.774684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.774829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.774981 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.775133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.775278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.775431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.775585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.775738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.775894 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.776145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.776382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.776543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.776708 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.776926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.777121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.777291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.777476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.777697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.777866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778329 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778654 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.778961 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.779117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.779270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.779558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.779784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.779986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.780158 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.780313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.780313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.780601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.780762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.780908 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781437 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.781888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.782184 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.782341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.782486 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.782640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.782792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.782947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.783092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.783244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.783396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.783548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.783694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784036 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.784808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.785151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.785299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.785445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.785589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.785762 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.785917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.786081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.786316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.786566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.786755 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.786937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.787180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.787341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.787507 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.787661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.787807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.787959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.788105 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.788256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.788414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.788572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.788726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.788871 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.789108 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.789286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.789433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.789586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.789740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.789894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.790040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.790202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.790354 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.790507 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.790660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.790806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.790949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.791117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.791270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.791421 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.791692 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.791852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.792005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.792165 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.792318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.792471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.792623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.792776 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.792776 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.793091 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.793261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.793407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.793551 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.793701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.793860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.794261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.794427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.794575 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.794728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.794874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.795032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.795186 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.795339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.795995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.796147 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.796320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.796568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.796790 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.796964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 07:23:17.797120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.797356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.797518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.797673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.797834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.797995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.798153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.798304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.798457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.798612 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.798767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.798920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.799067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.799212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.799362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.799516 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.799669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.799669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800494 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800647 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.800962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.801126 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.801272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.801424 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.801578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.801724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.801868 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802018 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802487 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802638 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.802945 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.803105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.803400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.803590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.803758 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.803915 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.804068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.804413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.804576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.804723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.804868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.805294 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.805442 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.805672 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.805827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.805827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.806124 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.806277 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.806431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.806660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.806915 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.807067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.807212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.807377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.807608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.807771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.807919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.808071 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.808224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.808371 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.808523 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.808669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.808813 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809336 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.809943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.810095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.810254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.810407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.810553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.810704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.810856 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.811019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.811756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.811903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.812048 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.812200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.812352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.812505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.812662 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.812816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813630 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.813920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.814064 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.814216 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.814542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.814705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.814859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815018 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815628 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815774 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.815932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.816083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.816239 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.816400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.816545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.816776 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.816965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.817128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.817281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.817436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.817608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.817848 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818620 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.818926 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819835 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.819987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.820146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.820302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.820447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.820599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.820745 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.820888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.821111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.821266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.821419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.821564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.821715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.821882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822336 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822489 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.822945 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.823090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.823241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.823392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.823543 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.823717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.823877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.824030 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.824189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.824349 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.824675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.824854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.825042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.825210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.825363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.825522 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.825688 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.825855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.826022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.826181 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.826335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.826493 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.826659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.826895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.827061 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.827214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.827373 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.827525 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.827689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.827860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.828094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.828262 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.828413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.828564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.828724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.828877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.829068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.829232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.829396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.829556 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.829722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.829882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.830035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.830186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.830357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.830524 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.830676 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.830841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831780 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.831938 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.832090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.832090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.832403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.832565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.832717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.832868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833560 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833652 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833746 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.833939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834419 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834886 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.834999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835272 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835551 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.835988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836169 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836254 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836455 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.836887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837073 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837242 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837409 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837687 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837848 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.837938 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838034 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838167 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838258 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838423 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838598 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838598 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.838972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839154 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839236 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839587 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839853 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.839937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.840920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.841115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.841269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.841421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.841590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.841750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.841910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.842070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.842230 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.842483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.842728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.842887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.843130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.843352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.843528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.843681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.843846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.843999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.844152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.844302 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.844459 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.844627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.844884 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.845122 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.845278 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.845429 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.845587 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.845764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.845917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.846068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.846220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.846386 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.846538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.846735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.846889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.847067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.847301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.847457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.847609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.847786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.847948 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.848108 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.848358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.848524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.848714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.848887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.849067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.849221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.849372 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.849534 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.849703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.849703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.850089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.850258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.850413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.850572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.850738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.850901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.851055 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.851214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.851378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.851538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.851699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.851852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852334 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852646 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.852970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.853149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.853304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.853464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.853631 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.853784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.853935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854264 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.854989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.855294 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.855448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.855600 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.855751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.855910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.856063 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.856224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.856383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.856542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.856702 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.856863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.857039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.857194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.857379 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.857534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.857686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.858464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.858629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.858783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.858947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.858947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.859332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.859495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.859656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.859818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.859971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.859971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.860270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.860431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.860593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.860759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.860929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.861121 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.861274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.861435 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.861587 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.861753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.861914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.862067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.862218 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.862377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.862529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.862693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.862848 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863179 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.863959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.864109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.864259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.864410 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.864574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.864733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.864894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.865081 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.865236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.865403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.865557 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.865708 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.865865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.866957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.867120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.867280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.867433 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.867584 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.867744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.867903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868217 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868369 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.868922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.869280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.869439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.869601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.869760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.869921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.870083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.870236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.870387 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.870545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.870705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.870865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871031 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871824 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.871988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.872143 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.872293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.872444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.872603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.872764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.872916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.873095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.873257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.873420 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.874377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.874603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.874760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.874913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.875074 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.875235 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.875388 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.875552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.875706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.875865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.876026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.876191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.876353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.876519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.876680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.876835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877643 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877797 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.877955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.878109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.878279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.878431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.878581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.878751 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.878982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.879146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.879311 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.879466 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.879747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.879921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.880074 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.880233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.880399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.880563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.880716 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.880867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.881077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.881250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.881412 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.881573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.881726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.881878 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.882037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.882203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.882364 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.882534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.882694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.882854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.883943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.884103 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.884256 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.884415 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.884580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.884741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885476 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885630 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.885941 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.886096 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.886247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.886398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.886549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.886718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.886915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.887078 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.887239 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.887399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.887560 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.887720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.887882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.888041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.888195 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.888346 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.888497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.888657 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.888820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.889002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.889202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.889358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.889517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.889750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890001 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.890951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.891102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.891262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.891423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.891576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.891737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.891889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.892040 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.892198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.892351 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.892515 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.892669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.892819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.893092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.893253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.893416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.893583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.893736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.893895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.894056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.894208 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.894368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.894533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.894701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.894861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895022 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895186 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.895974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.896134 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.896295 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.896448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.896600 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.896758 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.896917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.897104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.897278 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.897450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.897606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.897765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.897925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.898078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.898238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.898397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.898550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.898709 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.898869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.899029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.899203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.899375 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.899534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.899687 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.899837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900003 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900164 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900625 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.900968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.901129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.901302 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.901462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.901623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.901785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.901946 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.902099 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.902249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.902400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.902551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.902708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.902870 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.903023 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.903181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.903344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.903495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.903717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.903717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.904044 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.904206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.904359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.904359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.904670 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.904860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.905055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.905221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.905375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.905536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.905778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.906010 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.906170 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.906359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.906608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.906864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.907123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.907424 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.907653 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.907856 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.908071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.908301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.908548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.908808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.909095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.909282 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.909439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.909605 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.909760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.909760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.910059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.910059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.910373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.910538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.910711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.910711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911337 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911808 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.911967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.912133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.912287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.912438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.912589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.912589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.912892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.913115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.913115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.913407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.913558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.913717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.913868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914666 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.914986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.915144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.915303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.915456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.915607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.915772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.915931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.916083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.916243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.916405 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.916565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.916741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.916901 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917096 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917203 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917295 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917489 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917645 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.917928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918086 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918314 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918537 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918615 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918687 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918845 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.918995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919306 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.919962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.920036 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.920105 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.920184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.920257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.920336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.920917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.921959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922183 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922260 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.922854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.923000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.923186 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.923331 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.923506 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.923707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.923875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.924034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.924173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.924309 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.924451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.924600 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.924742 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.925101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.925221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.925401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.925682 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.925776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.926038 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.926265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.926365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.926668 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.926772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.926991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.927315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.927454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.927923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.928065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.928207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.928345 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.928482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.928612 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.928862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.929034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.929192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.929468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.929613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.930251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.930367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.930642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.930744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.930961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.931246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.931355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.931584 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.931737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.931899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.932216 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.932356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.932533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.932725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.932909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.933180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.933328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.933495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.933729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.933847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.934142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.934243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.934472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.934683 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.934814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.935138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.935273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.935457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.935664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.935778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.936634 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.936849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.937018 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.937192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.937349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.937639 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.937829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.938006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.938180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.938321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.938571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.938709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.938890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.939175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.939316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.939515 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.939674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.939834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.940153 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.940246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.940470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.940630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.940789 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.941133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.941241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.941464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.941679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.941803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.942127 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.942232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.942445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.942681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.942773 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.943073 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.943187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.943602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.943721 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.943922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.944200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.944292 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.944574 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.944709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.944903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.945243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.945381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.945569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.945740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.945904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.946215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.946312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.946526 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.946733 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.946834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.947146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.947245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.947459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.947735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.947835 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.948090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.948242 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.948402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.948725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.948893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.949105 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.949268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.949689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.949961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.950116 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.950274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.950612 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.950768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.950950 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.951106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.951263 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.951614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.951834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.952126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.952289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.952518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.952672 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.952840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.953142 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.953250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.953506 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.953649 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.953821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.954138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.954273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.954462 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.954635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.954777 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.955081 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.955255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.955402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.955633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.955725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.956034 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.956148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.956349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.956661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.956752 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.956993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.957229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.957339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.957615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.957742 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.957922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.958233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.958325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.958544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.958725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.958884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.959160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.959316 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.959566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.959787 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.959937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.960182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.960306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.960550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.960723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.960887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.961074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.961233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.961389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.961546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.961704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.961861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962010 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962166 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962314 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962829 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.962999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.963153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.963396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.963581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.963814 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.963992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.964210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.964389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.964544 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.964708 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.964858 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.965045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.965212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.965368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.965551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.965711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.965867 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.966098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.966254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.966438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.966591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.966749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.967048 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.967239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.967450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.967903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.968073 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.968309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.968462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.968618 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.968909 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.969106 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.969267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.969447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.969603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.969874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.970130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.970295 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.970456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.970613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.970800 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.970931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.971117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.971430 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.971534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.971744 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.971991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.972085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.972363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.972468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.972707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.972799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.973054 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.973150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.973375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.973524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.973694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.973792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974015 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974500 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974742 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.974964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.975058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.975281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.975533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.975679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.975893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.975993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.976234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.976389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.976546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.976903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.977025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.977309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.977447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.977635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.977951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.978064 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.978268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.978437 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.978597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.978926 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.979026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.979245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.979414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.979574 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.979892 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.979984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.980228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.980380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.980578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.980872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.981020 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.981259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.981379 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.981571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.981859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.981952 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.982181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.982352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.982497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.982819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.983410 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.983870 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.984275 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.984607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.984781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.984935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.985138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.985311 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.985470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.985628 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.985807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.985957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.986136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.986301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.986451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.986599 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.986748 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.986940 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.987092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.987250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.987411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.987568 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.987718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.987873 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.988031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.988187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.988336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.988483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.988483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.988764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989330 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.989797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.990175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.990332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.990332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.990648 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.990893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991064 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991830 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.991987 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.992135 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.992281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.992434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.992645 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.992810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.993021 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.993192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.993350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.993647 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.993770 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.993964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.994159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.994286 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.994608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.994760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.994911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.995222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.995365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.995538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.995678 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.995870 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.996018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.996201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.996512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.996657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.996843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997660 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997841 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.997995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.998161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.998333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.999344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.999581 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.999581 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:17.999881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.000030 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.000178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.000328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.000482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.000639 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.000801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.001076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.001246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.001407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.001563 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.001720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.001880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.002072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.002234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.002394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.002629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.002794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.003032 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.003197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.003346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.003584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.003881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.004066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.004220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.004387 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.004627 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.004846 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.005044 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.005210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.005368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.005519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.005667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.005912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.006077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.006240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.006456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 07:23:18.006621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.007009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.007548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.008031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.008508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.008861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.009217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.009553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.009864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.010186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.010508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.010835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.011177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.011498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.011812 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.012245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.012570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.012899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.013253 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.013575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.013908 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.014551 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.014879 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.015210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.015532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.015872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.016222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.016560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.016894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.017239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.017553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.017865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.018184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.018512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.018828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.019138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.019450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.019767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.020079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.020389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.020706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.021039 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.021355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.021666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.021976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.022286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.022596 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.022903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.023215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.023528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.023839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.024147 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.024454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.024760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.025092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.025430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.025771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.026093 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.026418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.026737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.027065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.027386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.027713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.028047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.028372 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.028684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.029042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.029360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.029677 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.030212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.030531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.030847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.031163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.031498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.031829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.032140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.032473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.032798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.033149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.033472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.033790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.034130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.034448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.034764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.035371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.035481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.035749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.036068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.036384 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.036696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.037037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.037366 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.037699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.038029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.038346 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.038687 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.039020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.039371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.039689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.040034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.040365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.040685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.041025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.041338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 07:23:18.041586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 07:23:18.068908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO dbcounter [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Registered counter for database nova_api Sep 28 07:23:18.089558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_db.sqlalchemy.engines [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.096576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writer thread running {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.103639 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO dbcounter [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Registered counter for database nova_api Sep 28 07:23:18.124639 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.131486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.152806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.context [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48cd990f-efc9-4822-a4b6-c05c4d52ec78(cell1) {{(pid=120451) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 07:23:18.157707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:23:18.158188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:23:18.159756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:23:18.160497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:23:18.160973 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:23:18.162963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:23:18.164970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO dbcounter [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Registered counter for database nova_cell0 Sep 28 07:23:18.169040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO dbcounter [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Registered counter for database nova_cell1 Sep 28 07:23:18.178237 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_db.sqlalchemy.engines [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.180418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_db.sqlalchemy.engines [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.186227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writer thread running {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.188838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.context [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),48cd990f-efc9-4822-a4b6-c05c4d52ec78(cell1) {{(pid=120452) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 07:23:18.190298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writer thread running {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.192883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:23:18.193392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:23:18.194954 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:23:18.195691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:23:18.196141 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:23:18.198360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:23:18.200373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO dbcounter [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Registered counter for database nova_cell0 Sep 28 07:23:18.204728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO dbcounter [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Registered counter for database nova_cell1 Sep 28 07:23:18.212045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.214805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.219382 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.338898 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO dbcounter [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Registered counter for database nova_cell0 Sep 28 07:23:18.347281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_db.sqlalchemy.engines [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.351859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writer thread running {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.380584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.390739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO dbcounter [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Registered counter for database nova_cell0 Sep 28 07:23:18.398198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_db.sqlalchemy.engines [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 07:23:18.402947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writer thread running {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 07:23:18.673930 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: WARNING keystonemiddleware.auth_token [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:23:18.681534 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: WARNING keystonemiddleware.auth_token [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:23:18.724035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:23:18.731414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:23:19.025828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: WARNING keystonemiddleware.auth_token [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:23:19.032131 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: WARNING keystonemiddleware.auth_token [None req-690f7089-8e6c-497c-aa3f-03035fe5c0f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:23:19.037500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588a514e9c0 pid: 120451 (default app) Sep 28 07:23:19.077405 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 07:23:19.083407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: WARNING keystonemiddleware.auth_token [None req-e68b8956-0572-4b22-b38f-7278342a3a65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 07:23:19.088650 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588a514e9c0 pid: 120452 (default app) Sep 28 07:23:55.167843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:55.170435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:55.171910 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:55.173101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:56.331465 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c82b5828-487f-48c1-8be6-bdc03183b131 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Action: 'create', calling method: .version_select at 0x7fa862f694c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1769879279", "metadata": {"Type": "work"}}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c82b5828-487f-48c1-8be6-bdc03183b131 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Request method failure captured: Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 122 Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aLOe0nYAb_paYudX8ZUof87wC2mwzdirULaEmDBzKz_VU6vKlgTQWTu0U8jrLROCaiZHh1Q_MC6jDhbnSAbBiQdExaaGK5ViClJgTZ0BXDNHQzHvZmLJqkWz8o8ZnteM6g0_eKa4aOFb4mEJB1qEzmpLZmcTKAu9g7fsVcOZklrrI Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:23:56.349819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb4b67535ab1418b9475c9199f374c92", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 1f7adc6bcf494189a77341fb643f2fda Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1769879279", "metadata": {"Type": "work"}}} Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: Sep 28 07:23:56.351446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1769879279', 'metadata': {'Type': 'work'}}}} Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise error Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi '#$%' Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:23:56.352332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 07:23:56.354840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 07:23:56.358907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 07:23:56.358907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.358907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c82b5828-487f-48c1-8be6-bdc03183b131 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:23:56.358907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c82b5828-487f-48c1-8be6-bdc03183b131 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.200975 Sep 28 07:23:56.358907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 07:23:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:23:56.755256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af1df78f-5895-49bd-8fd1-6bbe05a04a3c tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Action: 'create', calling method: .version_select at 0x7fa863015f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1973485231", "metadata": {"Type": "work"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af1df78f-5895-49bd-8fd1-6bbe05a04a3c tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Request method failure captured: Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 120 Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aLOe0nYAb_paYudX8ZUof87wC2mwzdirULaEmDBzKz_VU6vKlgTQWTu0U8jrLROCaiZHh1Q_MC6jDhbnSAbBiQdExaaGK5ViClJgTZ0BXDNHQzHvZmLJqkWz8o8ZnteM6g0_eKa4aOFb4mEJB1qEzmpLZmcTKAu9g7fsVcOZklrrI Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:23:56.763465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb4b67535ab1418b9475c9199f374c92", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 1f7adc6bcf494189a77341fb643f2fda Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1973485231", "metadata": {"Type": "work"}}} Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:23:56.765079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1973485231', 'metadata': {'Type': 'work'}}}} Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise error Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi '0' Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:23:56.766171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 07:23:56.767674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 07:23:56.769189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 07:23:56.769189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.771891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af1df78f-5895-49bd-8fd1-6bbe05a04a3c tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:23:56.771891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af1df78f-5895-49bd-8fd1-6bbe05a04a3c tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.407017 Sep 28 07:23:56.771891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 07:23:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:23:56.782340 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a55bb5e1-08ab-4dc6-a223-d9f49450e762 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Action: 'create', calling method: .version_select at 0x7fa862f69dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-784013254", "metadata": {"Type": "work"}}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a55bb5e1-08ab-4dc6-a223-d9f49450e762 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Request method failure captured: Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 118 Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aLOe0nYAb_paYudX8ZUof87wC2mwzdirULaEmDBzKz_VU6vKlgTQWTu0U8jrLROCaiZHh1Q_MC6jDhbnSAbBiQdExaaGK5ViClJgTZ0BXDNHQzHvZmLJqkWz8o8ZnteM6g0_eKa4aOFb4mEJB1qEzmpLZmcTKAu9g7fsVcOZklrrI Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:23:56.786052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb4b67535ab1418b9475c9199f374c92", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 1f7adc6bcf494189a77341fb643f2fda Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-784013254", "metadata": {"Type": "work"}}} Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: Sep 28 07:23:56.787648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-784013254', 'metadata': {'Type': 'work'}}}} Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise error Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi '' Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:23:56.788582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 07:23:56.790161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 07:23:56.791577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 07:23:56.791577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:56.791749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a55bb5e1-08ab-4dc6-a223-d9f49450e762 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:23:56.792662 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a55bb5e1-08ab-4dc6-a223-d9f49450e762 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014534 Sep 28 07:23:56.803701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93eeed74-fbdd-49eb-9810-73fd58749afa tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Calling method '.version_select at 0x7fa862fa7af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:23:56.804132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 07:23:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:23:56.834705 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:56.835956 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:56.836992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:56.838039 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:23:56.885045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7e4d5f35-4244-4799-af5d-8162137482a5 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862e271f0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:23:57.174621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7e4d5f35-4244-4799-af5d-8162137482a5 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ad88aa9-bc55-4e06-8d74-bd03757ddb17" status: 200 len: 351 microversion: 2.1 time: 0.294723 Sep 28 07:23:57.175780 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:23:56 2022] GET /compute/v2.1/os-volumes/6ad88aa9-bc55-4e06-8d74-bd03757ddb17 => generated 351 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:23:57.187551 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-93eeed74-fbdd-49eb-9810-73fd58749afa tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] HTTP exception thrown: Volume tempest-invalid-1784142466 could not be found. Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93eeed74-fbdd-49eb-9810-73fd58749afa tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Request method failure captured: Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1784142466 HTTP/1.1 Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aLOe0nYAb_paYudX8ZUof87wC2mwzdirULaEmDBzKz_VU6vKlgTQWTu0U8jrLROCaiZHh1Q_MC6jDhbnSAbBiQdExaaGK5ViClJgTZ0BXDNHQzHvZmLJqkWz8o8ZnteM6g0_eKa4aOFb4mEJB1qEzmpLZmcTKAu9g7fsVcOZklrrI Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:23:57.191333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb4b67535ab1418b9475c9199f374c92", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 1f7adc6bcf494189a77341fb643f2fda Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Volume tempest-invalid-1784142466 could not be found. Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'tempest-invalid-1784142466'} Sep 28 07:23:57.192566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1784142466 could not be found. (HTTP 404) (Request-ID: req-25bf6049-bce8-43bb-86a4-df895a468e29) Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.193363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 07:23:57.199706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1784142466 could not be found. Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:23:57.202117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1784142466 could not be found. Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1784142466 could not be found. Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-93eeed74-fbdd-49eb-9810-73fd58749afa tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Returning 404 to user: Volume tempest-invalid-1784142466 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-93eeed74-fbdd-49eb-9810-73fd58749afa tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1784142466" status: 404 len: 99 microversion: 2.1 time: 0.393265 Sep 28 07:23:57.203929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 2/5] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 07:23:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1784142466 => generated 99 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 28 07:23:57.210402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3321e0c2-efed-4f0b-8c16-930b370ab74d tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004555 Sep 28 07:23:57.210402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 4/6] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Sep 28 07:23:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 07:23:57.213887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-39717ef8-ded7-4c5e-ac60-fa58d47d8af2 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003939 Sep 28 07:23:57.218571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Sep 28 07:23:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 07:23:57.225834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-55e59f59-6e48-465a-83c5-18546870da24 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Calling method '.version_select at 0x7fa862df6b80>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:23:57.271986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-55e59f59-6e48-465a-83c5-18546870da24 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] HTTP exception thrown: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-55e59f59-6e48-465a-83c5-18546870da24 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Request method failure captured: Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/os-volumes/47535c94-3219-48bf-b476-07ce53ac59ca HTTP/1.1 Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aLOe0nYAb_paYudX8ZUof87wC2mwzdirULaEmDBzKz_VU6vKlgTQWTu0U8jrLROCaiZHh1Q_MC6jDhbnSAbBiQdExaaGK5ViClJgTZ0BXDNHQzHvZmLJqkWz8o8ZnteM6g0_eKa4aOFb4mEJB1qEzmpLZmcTKAu9g7fsVcOZklrrI Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:23:57.276738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb4b67535ab1418b9475c9199f374c92", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 1f7adc6bcf494189a77341fb643f2fda Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '47535c94-3219-48bf-b476-07ce53ac59ca'} Sep 28 07:23:57.278831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. (HTTP 404) (Request-ID: req-6fba34b7-eae3-496a-84e2-57be4ab97246) Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.280267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 07:23:57.281878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 07:23:57.283168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. Sep 28 07:23:57.284499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.287014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-55e59f59-6e48-465a-83c5-18546870da24 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Returning 404 to user: Volume 47535c94-3219-48bf-b476-07ce53ac59ca could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:23:57.288379 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-55e59f59-6e48-465a-83c5-18546870da24 tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/47535c94-3219-48bf-b476-07ce53ac59ca" status: 404 len: 109 microversion: 2.1 time: 0.068473 Sep 28 07:23:57.289558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:23:57 2022] DELETE /compute/v2.1/os-volumes/47535c94-3219-48bf-b476-07ce53ac59ca => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:23:57.301763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-837e1001-89f6-467e-9fbf-ea718a0246ab tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Calling method '.version_select at 0x7fa862d4f0d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:23:57.440887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-837e1001-89f6-467e-9fbf-ea718a0246ab tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] HTTP exception thrown: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-837e1001-89f6-467e-9fbf-ea718a0246ab tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Request method failure captured: Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/os-volumes/1a2279b1-307e-45a1-9407-fb04584242a3 HTTP/1.1 Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aLOe0nYAb_paYudX8ZUof87wC2mwzdirULaEmDBzKz_VU6vKlgTQWTu0U8jrLROCaiZHh1Q_MC6jDhbnSAbBiQdExaaGK5ViClJgTZ0BXDNHQzHvZmLJqkWz8o8ZnteM6g0_eKa4aOFb4mEJB1qEzmpLZmcTKAu9g7fsVcOZklrrI Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:23:57.443735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fb4b67535ab1418b9475c9199f374c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fb4b67535ab1418b9475c9199f374c92", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fb4b67535ab1418b9475c9199f374c92 Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesNegativeTest-1949581075 Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 1f7adc6bcf494189a77341fb643f2fda Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesNegativeTest-1949581075-project Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '1a2279b1-307e-45a1-9407-fb04584242a3'} Sep 28 07:23:57.445496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. (HTTP 404) (Request-ID: req-2e03c53f-5124-4517-b8a7-4c338877b144) Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.446641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:23:57.448053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 07:23:57.449356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. Sep 28 07:23:57.450755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:23:57.453798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-837e1001-89f6-467e-9fbf-ea718a0246ab tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] Returning 404 to user: Volume 1a2279b1-307e-45a1-9407-fb04584242a3 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:23:57.455149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-837e1001-89f6-467e-9fbf-ea718a0246ab tempest-VolumesNegativeTest-1949581075 tempest-VolumesNegativeTest-1949581075-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1a2279b1-307e-45a1-9407-fb04584242a3" status: 404 len: 109 microversion: 2.1 time: 0.160218 Sep 28 07:23:57.455844 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 4/9] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:23:57 2022] GET /compute/v2.1/os-volumes/1a2279b1-307e-45a1-9407-fb04584242a3 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 07:23:58.960580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4bd63c3f-b206-42d9-a8db-a3fdd6157e41 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862d5a3a0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:23:59.095842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4bd63c3f-b206-42d9-a8db-a3fdd6157e41 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b3f53118-43b1-4c4f-b966-8a462ab9e556" status: 200 len: 350 microversion: 2.1 time: 0.141608 Sep 28 07:23:59.104256 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 6/10] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:23:58 2022] GET /compute/v2.1/os-volumes/b3f53118-43b1-4c4f-b966-8a462ab9e556 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:00.730049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16c4b35d-24a9-4928-a25a-650419bd8fed tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862da4d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:00.869825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16c4b35d-24a9-4928-a25a-650419bd8fed tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c38106fb-d360-4647-ad69-70e1be98e494" status: 200 len: 350 microversion: 2.1 time: 0.144172 Sep 28 07:24:00.870387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 5/11] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:24:00 2022] GET /compute/v2.1/os-volumes/c38106fb-d360-4647-ad69-70e1be98e494 => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:00.883662 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7c73ebe3-6b60-493e-925c-8a6c14adf135 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862df6c10>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:01.120349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7c73ebe3-6b60-493e-925c-8a6c14adf135 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.240317 Sep 28 07:24:01.135153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 7/12] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Sep 28 07:24:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:01.141132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08849b3a-412f-4a0a-9a44-388a015bf508 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862d4f430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:01.393931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08849b3a-412f-4a0a-9a44-388a015bf508 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.256789 Sep 28 07:24:01.401020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 6/13] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Sep 28 07:24:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:01.409611 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1f7e4d5f-2e2b-458d-b0d1-ba51d099534a tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862d5ac10>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:01.704225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1f7e4d5f-2e2b-458d-b0d1-ba51d099534a tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.298659 Sep 28 07:24:01.705191 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 8/14] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Sep 28 07:24:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:01.723404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-785bac37-719e-490b-bc44-6fab97a9f41c tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862d599d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:02.005783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-785bac37-719e-490b-bc44-6fab97a9f41c tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.285995 Sep 28 07:24:02.006676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 7/15] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Sep 28 07:24:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:02.034094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-60725b1e-fd38-430e-8043-0e195274d6d8 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862dfff70>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:02.277992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-60725b1e-fd38-430e-8043-0e195274d6d8 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.255862 Sep 28 07:24:02.278660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 9/16] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Sep 28 07:24:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:02.295258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d1638c3e-2578-43a8-8441-dec5085ad5ab tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862d59700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:02.507558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d1638c3e-2578-43a8-8441-dec5085ad5ab tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.216875 Sep 28 07:24:02.517103 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 8/17] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Sep 28 07:24:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:02.526871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-30f0981b-fea5-4746-bf5d-e14230bbb6a1 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862dff1f0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:02.741915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-30f0981b-fea5-4746-bf5d-e14230bbb6a1 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.219586 Sep 28 07:24:02.742648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 10/18] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Sep 28 07:24:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:02.758149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af3ec218-9ba0-4145-b886-4bd2a6c705d7 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] Calling method '.version_select at 0x7fa862d4f3a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:02.917670 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af3ec218-9ba0-4145-b886-4bd2a6c705d7 tempest-VolumesTestJSON-1876333802 tempest-VolumesTestJSON-1876333802-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.163554 Sep 28 07:24:02.918236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 9/19] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Sep 28 07:24:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:11.012496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c604a4f7-aad7-46be-84e3-c6daf4bd6034 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: .version_select at 0x7fa862f7df70>, body: {"keypair": {"name": "tempest-keypair-1759020567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlVUV3tjp/0WIwi2IHacAX4deZ7GV2wOUaEx6z5xLgU19IQDk8VPeM+i8Lsu3FqZHfL0EYjt68auVTE/Dq309w9xphCNKjFcSGMSJurafc2/defJBwzODL9jl61CmFbWw=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:11.142235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c604a4f7-aad7-46be-84e3-c6daf4bd6034 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for project 6f391a1187074b68b3c6a887634b479b. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:11.163406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c604a4f7-aad7-46be-84e3-c6daf4bd6034 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for user 269ef35368734dcd9d3cc901db39fe10 and project 6f391a1187074b68b3c6a887634b479b. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:11.303953 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c604a4f7-aad7-46be-84e3-c6daf4bd6034 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.207660 Sep 28 07:24:11.304806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:24:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:15.127653 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1715179706", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:15.407211 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] validate_networks() for [('2074fef2-a4a7-4181-98e7-e7c64838b0de', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:24:16.582199 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1417032887", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "networks": [{"uuid": "716c4394-ff90-4541-b49b-242eeb2d130a"}]}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:16.756350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] validate_networks() for [('716c4394-ff90-4541-b49b-242eeb2d130a', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:24:18.161253 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:24:18.162042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:24:18.163159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:24:18.163697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:24:18.164222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:24:18.197204 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:18.198444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:18.201175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:18.202585 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:18.203656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:18.206588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:18.301626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for project fc7675d275394d8893d0facf20d3a4e7. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:18.318420 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for user d286b1e0afe9413291e0e2503b4c204a and project fc7675d275394d8893d0facf20d3a4e7. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:18.352092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:24:18.364904 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:24:18.634737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f5640294-7c78-41f7-a2fb-07f3cf5992ac tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.723174 Sep 28 07:24:18.649004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 10/21] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:24:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:24:19.139471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:24:19.140573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:24:19.141207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:24:19.142281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:24:19.142281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:24:19.171605 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:19.172227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:19.173304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:19.174667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:19.175703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:19.176824 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:19.230143 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Getting quotas for project 416f25107a0d4eb0bab9d92e59cf07f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:19.236541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Getting quotas for user c0983c1e9f7649c2890000959cea452b and project 416f25107a0d4eb0bab9d92e59cf07f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:19.284581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:24:19.291107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:24:19.378154 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ded30194-5eb7-4d6b-8f80-6443b6c76888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'create', calling method: .version_select at 0x7fa862457a60>, body: {"keypair": {"name": "tempest-keypair-1991585320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFziB/l1JLlRViUn/oCDH9IySwEkED7DAkToS9MraLi1TTKywvezVolb7EX2J9kMaPs9V7A/Mru9VxQpqZEV5YVqbmh4eOlADKaY7SSnxPHASR862zH7jON7PzhAdiaQrg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:19.525046 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-ded30194-5eb7-4d6b-8f80-6443b6c76888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for project 60646ef7a4ad4eb1860952504092742d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:19.542396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-ded30194-5eb7-4d6b-8f80-6443b6c76888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for user 764cfe23613e4a97ba05f8bf0ed77ef1 and project 60646ef7a4ad4eb1860952504092742d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:19.573854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1f893eb8-1199-47e4-9ae1-f90405c0c3f5 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.269106 Sep 28 07:24:19.584338 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 12/22] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 07:24:19.597634 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-98a8ce93-5430-404a-9fcc-d7fc457bcded tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:19.599724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-98a8ce93-5430-404a-9fcc-d7fc457bcded tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:19.664531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ded30194-5eb7-4d6b-8f80-6443b6c76888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.013376 Sep 28 07:24:19.665766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 11/23] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Sep 28 07:24:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1016 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 07:24:19.677399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99c13853-b289-4d6e-bcfb-e1ee437b5a5c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:19.682679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99c13853-b289-4d6e-bcfb-e1ee437b5a5c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:19.870178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-98a8ce93-5430-404a-9fcc-d7fc457bcded tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:19.893850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-98a8ce93-5430-404a-9fcc-d7fc457bcded tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1222 microversion: 2.1 time: 0.306405 Sep 28 07:24:19.894664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 13/24] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:19 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1222 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:19.902168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-323751766", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a68568d7-53b7-4646-8455-51184edc4b5d"}], "security_groups": [{"name": "tempest-securitygroup--13425789"}], "key_name": "tempest-keypair-1759020567", "user_data": "}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:20.062315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-99c13853-b289-4d6e-bcfb-e1ee437b5a5c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:20.112989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99c13853-b289-4d6e-bcfb-e1ee437b5a5c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1215 microversion: 2.1 time: 0.441295 Sep 28 07:24:20.116661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:19 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1215 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:20.145727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1441711986", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:20.177161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] validate_networks() for [('a68568d7-53b7-4646-8455-51184edc4b5d', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:24:20.297440 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] validate_networks() for [('2074fef2-a4a7-4181-98e7-e7c64838b0de', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:24:21.658290 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:24:21.660091 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:24:21.661025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:24:21.661916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:24:21.662695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:24:21.716419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:21.718679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:21.720636 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:21.721612 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:21.723787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:21.724443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:21.796757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for project 6f391a1187074b68b3c6a887634b479b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:21.812855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for user 269ef35368734dcd9d3cc901db39fe10 and project 6f391a1187074b68b3c6a887634b479b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:21.825011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:24:21.826675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:24:21.827768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:24:21.828567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:24:21.829411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:24:21.848906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:21.851428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:21.852175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:21.854474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:21.855250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:21.858016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:21.858285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:24:21.869608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:24:21.917610 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for project fc7675d275394d8893d0facf20d3a4e7. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:21.941318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for user d286b1e0afe9413291e0e2503b4c204a and project fc7675d275394d8893d0facf20d3a4e7. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:21.980859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:24:21.992683 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:24:22.055391 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e0ec0489-ca3b-4df4-b652-9f563901f84d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.158642 Sep 28 07:24:22.056704 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 14/26] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:24:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 07:24:22.092276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:22.113531 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:22.148730 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:22.151883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:22.152707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:22.155706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:22.161190 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:22.164549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:22.217083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-437f3319-a2d3-4a2d-9bfd-375ef72923a0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.076056 Sep 28 07:24:22.218402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 13/27] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:24:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:24:22.231384 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9d5bb9f1-8521-491a-8f91-e2dbfc289a08 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:22.232522 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9d5bb9f1-8521-491a-8f91-e2dbfc289a08 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:22.626462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9d5bb9f1-8521-491a-8f91-e2dbfc289a08 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:22.636282 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9d5bb9f1-8521-491a-8f91-e2dbfc289a08 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1237 microversion: 2.1 time: 0.416606 Sep 28 07:24:22.656315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 14/28] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:22 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1237 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:22.676840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36592ced-eee5-4f4d-ad44-4f8a3cd3d7c8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:22.683256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36592ced-eee5-4f4d-ad44-4f8a3cd3d7c8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:23.190933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-36592ced-eee5-4f4d-ad44-4f8a3cd3d7c8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:23.217937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36592ced-eee5-4f4d-ad44-4f8a3cd3d7c8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1222 microversion: 2.1 time: 0.554471 Sep 28 07:24:23.229155 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:22 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1222 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:23.267866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:23.297509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a00b2785-0b15-4c47-8a92-255a893e4dd2 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1219 microversion: 2.1 time: 1.234710 Sep 28 07:24:23.299079 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 15/30] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:22 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1219 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:23.662663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:23.663337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:23.687829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:23.704711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:23.705198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:23.706287 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:23.706747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:23.707176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:23.981887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:23.996165 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c33929cc-cbe1-431e-9705-66d8392040eb tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1233 microversion: 2.1 time: 0.337727 Sep 28 07:24:24.014696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 16/31] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:23 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1233 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:24.250857 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:24.251423 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:24.270052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:24.271710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:24.272164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:24.273295 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:24.273992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:24.274426 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:24.329194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:24.329904 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:24.338383 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:24.339009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:24.339552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:24.340881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:24.342170 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:24.342794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:24.387925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:24.406169 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-09a8ebfa-26af-4586-91ee-45222f78d9af tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.161007 Sep 28 07:24:24.408188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 16/32] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:24 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:24.421186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:24.429344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04a309c5-82b1-4f4d-9111-e6c36b10b135 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1211 microversion: 2.1 time: 0.104484 Sep 28 07:24:24.434991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 17/33] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:24 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:24.723736 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-28731558", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad570fd1-a088-4600-9208-cf0f3843e053"}], "security_groups": [{"name": "tempest-securitygroup--1049340149"}], "key_name": "tempest-keypair-1991585320", "user_data": "}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:25.009713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] validate_networks() for [('ad570fd1-a088-4600-9208-cf0f3843e053', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:24:25.023419 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:25.024150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:25.031885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:25.032478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:25.033111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:25.037584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:25.038240 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:25.038855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:25.150923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:25.161003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-364b5a8f-90f2-4231-917c-46268b0f7f75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1233 microversion: 2.1 time: 0.141489 Sep 28 07:24:25.161998 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 18/34] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:25 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1233 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:25.432339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:25.433866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:25.440465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:25.441187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:25.441711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:25.442494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:25.443030 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:25.443571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:25.510779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:25.519033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-638d7c30-90c0-4d55-9dd7-39dd847fdc9f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.090809 Sep 28 07:24:25.519610 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 19/35] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:25 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:25.531984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:25.532698 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:25.539251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:25.539994 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:25.540659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:25.541636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:25.542162 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:25.542655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:25.610212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:25.621250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d8f3b1f-d811-4513-a778-5ca345425223 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1211 microversion: 2.1 time: 0.094980 Sep 28 07:24:25.622618 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 20/36] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:25 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:26.052419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:24:26.052916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:24:26.056141 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:24:26.056783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:24:26.057963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:24:26.076615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.077171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.077836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.079580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.080222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.081118 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.126700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for project 60646ef7a4ad4eb1860952504092742d. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:24:26.130964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for user 764cfe23613e4a97ba05f8bf0ed77ef1 and project 60646ef7a4ad4eb1860952504092742d. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:24:26.146591 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:24:26.148553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:24:26.186074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:26.186757 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:26.195074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.200506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.200978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.201743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.202206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.202637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.263518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-14203539-06c4-46f0-8624-e3d1e5926411 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.544362 Sep 28 07:24:26.264733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 17/37] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Sep 28 07:24:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 07:24:26.287624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7f092e82-8bff-496b-a6e4-862a012e7070 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:26.288429 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7f092e82-8bff-496b-a6e4-862a012e7070 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:26.331939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:26.342939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b883c65-d42a-418a-8faa-5164343d78f9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1233 microversion: 2.1 time: 0.161312 Sep 28 07:24:26.366429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 21/38] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:26 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1233 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:26.388700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7f092e82-8bff-496b-a6e4-862a012e7070 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:26.399878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7f092e82-8bff-496b-a6e4-862a012e7070 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:26.401854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7f092e82-8bff-496b-a6e4-862a012e7070 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:26.404542 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7f092e82-8bff-496b-a6e4-862a012e7070 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1280 microversion: 2.20 time: 0.130710 Sep 28 07:24:26.405890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 18/39] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:26 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:26.542746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:26.543374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:26.551276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.551781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.552220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.553125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.553730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.554304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.638371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:26.650754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-abe252cd-6f41-4bdc-b0f0-1dad56d94392 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.112512 Sep 28 07:24:26.650947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:26.651894 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:26.669474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 22/40] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:26 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:26.673738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.674327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.674762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.675491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:26.676047 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:26.676455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:26.854420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:26.869551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-68db8b48-b4c8-4849-9859-784bbc411211 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1211 microversion: 2.1 time: 0.221315 Sep 28 07:24:26.874072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 19/41] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:26 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1211 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:27.368301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:27.372935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:27.383746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.390011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.391323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.392984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.396982 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.398481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.432718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:27.433600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:27.449398 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.450221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.450917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.451773 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.452235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.452641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.543376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:27.568638 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:27.573320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:27.574486 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e3e00aa9-138d-4193-9032-3f6101d1efc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.146665 Sep 28 07:24:27.575801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 20/42] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:27 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:24:27.639238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:27.647782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb17337e-ea5d-4614-ac5c-bb4f5dc703c7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1233 microversion: 2.1 time: 0.283915 Sep 28 07:24:27.658590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 23/43] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:27 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1233 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:27.680636 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:27.681991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:27.691354 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.695964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.696426 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.697198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.697844 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.698274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.796259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:27.805679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9d8e658e-1d9d-4cb6-ad6b-38f391908b8e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.131029 Sep 28 07:24:27.807130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 21/44] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:27 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:27.895869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:27.896492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:27.902707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.903986 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.904846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:27.905659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:27.906336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:27.906985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.001714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:28.016348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-768087c6-e7f3-4f63-a8cb-58c73ad96368 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1267 microversion: 2.1 time: 0.124212 Sep 28 07:24:28.032766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 24/45] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:27 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:28.601438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:28.602700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:28.625035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:28.627954 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:28.628566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.632116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:28.634070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:28.636128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.675757 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:28.676554 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:28.715585 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:28.716075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:28.716504 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.717225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:28.719474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:28.719898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.802032 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:28.810569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:28.814686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:28.817905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:28.818484 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-309daf42-4ea2-45ac-b4d4-5a635a5f1313 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1233 microversion: 2.1 time: 0.148611 Sep 28 07:24:28.832219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 25/46] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:28 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1233 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:28.832219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:28.832219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:28.842369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5f50e09a-d838-44c5-9aee-bd10f39d9618 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.244591 Sep 28 07:24:28.843772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 22/47] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:28 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:28.863624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:28.864130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:28.864567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.865922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:28.866382 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:28.867247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:28.953643 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:28.967521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a2ca8f2-6204-4aed-9d4f-b63a59f67876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.141770 Sep 28 07:24:28.974310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:28 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:29.043410 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:29.044511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:29.054913 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:29.055838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:29.056383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:29.057990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:29.058699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:29.059793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:29.160437 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:29.169592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6ea7c46f-7bd1-4a3e-a939-a47d7c4e317a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1267 microversion: 2.1 time: 0.133036 Sep 28 07:24:29.171058 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 23/49] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:29 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:29.845505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:29.846220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:29.852339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:29.853069 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:29.853647 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:29.854630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:29.855054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:29.855476 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:29.869349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:29.870825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:29.881963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:29.884462 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:29.885116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:29.886025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:29.888280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:29.889065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:29.929705 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:29.941402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e824e12-0b03-4a0e-9c0c-9bb17a3c50de tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1233 microversion: 2.1 time: 0.099513 Sep 28 07:24:29.954028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 27/50] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:29 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1233 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:29.963717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:29.974510 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:29.976234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:29.977640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b9d9467d-dc35-4b02-b1b2-21e92dcc46e8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.112717 Sep 28 07:24:29.978674 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 24/51] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:29 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:24:29.994048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:29.995032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:30.002624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:30.003107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:30.003953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:30.004656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:30.005134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:30.005850 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:30.075568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:30.083687 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0be57be3-37d3-4791-b559-3ba7bc74d6d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.093401 Sep 28 07:24:30.087791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 28/52] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:29 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:30.193464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:30.194082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:30.200770 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:30.201280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:30.201707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:30.202398 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:30.202855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:30.203269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:30.268310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:30.276064 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9d69394d-e089-4145-8389-02ff75989724 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1267 microversion: 2.1 time: 0.086580 Sep 28 07:24:30.276656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 25/53] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:30 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:30.966133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:30.966900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:30.979892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:30.980390 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:30.980878 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:30.984232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:30.984709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:30.986772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.004762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:31.005403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:31.016592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:31.017038 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:31.017482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.019343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:31.027405 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:31.028079 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.166846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:31.178062 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2799f79e-b6a4-4341-8969-0b2128046468 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.218069 Sep 28 07:24:31.181265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 29/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:30 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:31.208509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:31.210076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:31.225527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:31.226926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:31.229104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.230106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:31.233088 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:31.233751 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.236225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:31.248460 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:31.251890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:31.253042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2627722e-4d0e-4e10-a707-ac7deb13db1f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.253720 Sep 28 07:24:31.261409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 26/55] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:30 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:31.300340 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:31.300961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:31.307970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:31.308883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:31.310064 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.311056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:31.311660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:31.312228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:31.367368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:31.381443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de1b7d3d-4f6b-47ee-898c-d36da13b2962 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.181772 Sep 28 07:24:31.382605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 30/56] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:31 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:31.439985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:31.454712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1046be56-cd5f-40d2-b11f-ac9714939342 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1273 microversion: 2.1 time: 0.158614 Sep 28 07:24:31.455416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 27/57] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:31 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:32.207514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:32.208818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:32.214472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:32.217619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.218436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.219006 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.220034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.221069 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.221937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.296432 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:32.297269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:32.307670 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.308247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.308862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.310896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.313842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.315868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.440112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:32.449254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:32.454069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:32.456652 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-61daec5a-1e15-40fd-99bb-27610392286b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.164485 Sep 28 07:24:32.468490 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 28/58] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:32 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:32.482107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:32.482725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:32.489568 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.490261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.490848 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.491699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.492290 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.492850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.511719 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:32.518679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:32.521596 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cde77ee0-a3df-49a3-80d1-53df2102dbec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.319366 Sep 28 07:24:32.522739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 31/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:32 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:32.529276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:32.530083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:32.537105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.537854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.538636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.539560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.540278 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.541170 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.613225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:32.627318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cc9449db-76dd-48ee-8871-abd675c53c1f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.155171 Sep 28 07:24:32.628366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 29/60] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:32 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:32.744434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:32.754077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b2066536-a9a8-461b-acb9-5380b1b032a1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.230023 Sep 28 07:24:32.754745 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 32/61] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:32 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:32.767464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3780a43-5882-4fed-90eb-bd39060f6d99", "tag": "648be1a4-0bc1-44aa-a1c5-4643d67519e4"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:32.803195 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:32.817668 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.818313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.818835 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.852364 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Creating event network-changed:648be1a4-0bc1-44aa-a1c5-4643d67519e4 for instance d3780a43-5882-4fed-90eb-bd39060f6d99 on hv-cinder-85944 Sep 28 07:24:32.852880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120451) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 07:24:32.853293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-c3bd5dda-fdad-4072-a2b3-d2d4dea6a730 req-3e545765-f6fa-492d-b7b5-a206d47378ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=120451) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 07:24:32.854449 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.854905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.855504 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.856418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:32.857068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:32.857797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:32.868476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.compute.rpcapi [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 07:24:32.868895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] Releasing lock "compute-rpcapi-router" {{(pid=120451) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 07:24:32.894705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a2ce4262-36a9-4d3f-9dc1-2d7f43bbbd99 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237745 Sep 28 07:24:32.895629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 30/62] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:24:33.490684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:33.491662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:33.493794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=22 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:33.500666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.501406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.502001 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.502860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.503459 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.504054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.553157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:33.555050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:33.580474 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.581333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.581951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.583154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.585281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.586327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.647114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:33.664775 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:33.670949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:33.672638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-60a72ee3-b3ed-4097-9b90-89b9c6ab5029 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.189443 Sep 28 07:24:33.673877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 33/63] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:33 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:24:33.682542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:33.683373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:33.690926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.691625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.692414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.693609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.694345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.694968 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.716553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:33.734588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f91e55d1-681d-406c-b298-7c038abee93b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.184424 Sep 28 07:24:33.734588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 31/64] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:33 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:33.772032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:33.780549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b6acd66-bdd3-4e1b-8001-1712319da7c1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.102133 Sep 28 07:24:33.781155 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 34/65] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:33 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:33.781293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:33.781933 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:33.797138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.797853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.798333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.799586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:33.800109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:33.800533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:33.964804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:33.968717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:33.975344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6a26eed0-4c19-47a7-8c86-1f2d0118a7f0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.199849 Sep 28 07:24:33.989838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 32/66] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:33 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:34.707104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:34.710967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:34.718183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:34.719520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:34.720156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:34.721104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:34.721879 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:34.722521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:34.759920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:34.761422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:34.785604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:34.785604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:34.785604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:34.803687 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:34.808365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:34.809848 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:34.923588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:34.942429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:34.948488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:34.953404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ac0b5007-2eb0-44cc-a09a-0e1e973cfcc7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.249889 Sep 28 07:24:34.954249 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 35/67] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:34 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:34.965537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:34.965537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:34.972498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:34.986210 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-92214f8a-094a-43c0-81b7-6fcac745fec4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.233903 Sep 28 07:24:34.993395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 33/68] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:34 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:34.995035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:34.999175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:34.999175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:35.002425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:35.002906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:35.003331 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:35.013712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:35.014789 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:35.023297 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:35.024137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:35.032939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:35.033981 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:35.034574 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:35.035096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:35.166502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:35.179058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-24cc99ca-9de7-46fa-8965-faccbc7fb2aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.223588 Sep 28 07:24:35.180846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 36/69] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:34 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:35.385746 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:35.397842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1c9b9c37-438d-4241-85c4-7dae1964f8ab tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.393481 Sep 28 07:24:35.400450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 34/70] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:35 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:35.984015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:35.985341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:35.991457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:36.012583 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.023731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:36.024581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:36.027200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.028289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.032376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.032529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.034916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.035509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.037270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.037905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.038579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.041087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.041927 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.130642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:36.138893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3283fc0b-7570-4b50-8eda-136fb0c31916 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.118984 Sep 28 07:24:36.139468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 35/71] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:36 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:36.173530 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:36.188873 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:36.193136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:36.194421 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6867076f-9759-4d12-9a6d-6517ead01868 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.216569 Sep 28 07:24:36.194990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:35 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:36.208436 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:36.209427 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:36.216031 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.224904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.225667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.226411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.226875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.227321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.308433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:36.316677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-857dd992-4379-4ffd-8227-4b2104443a7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.112896 Sep 28 07:24:36.317511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 36/73] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:36 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:36.433269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:36.435605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:36.453375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.454010 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.454532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.455330 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:36.455878 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:36.456406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:36.614252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:36.623089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5d861ce-ffd0-4604-87ec-0115e83199b3 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.196944 Sep 28 07:24:36.623662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 38/74] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:36 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:37.163376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:37.164019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:37.165867 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=26 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:37.171927 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.172436 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.172851 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.173743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.174104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.174533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.224492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:37.225307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:37.232574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.233168 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.233696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.234505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.235024 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.235515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.243722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:37.253751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-dcf32971-6c99-4fee-9f64-d92b26bc46c9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.094002 Sep 28 07:24:37.254640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 37/75] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:37 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:37.311363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:37.319470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:37.320924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:37.322282 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5e5e54c-271c-4306-b5d2-190c682e1a59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.102120 Sep 28 07:24:37.323189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:37 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:24:37.339718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:37.340392 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:37.350166 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.350669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.351760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.352484 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.352965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.353406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.425352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:37.433275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-062381ab-82c7-4965-8292-77df6c3062c2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.097291 Sep 28 07:24:37.434772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 38/77] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:37 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:37.645717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:37.646318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:37.653965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.654200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.654634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.655328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:37.655771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:37.656192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:37.791978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:37.800662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cd9449c6-a9ec-443c-b2d6-a33733ec48d6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.158687 Sep 28 07:24:37.801267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 40/78] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:37 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:38.276600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:38.277468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:38.284086 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.284566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.285015 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.285710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.286154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.286566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.349805 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:38.350831 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:38.352076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:38.358788 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-64dfae0c-d3fe-4d5d-b505-49930de6997b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.085988 Sep 28 07:24:38.359076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.359353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 39/79] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:38 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:38.360084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.360412 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.361427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.362118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.362806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.442276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:38.451575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:38.453073 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:38.454274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-025319b5-e9c9-45bf-a224-f903c1567bc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.107976 Sep 28 07:24:38.456585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:38.457810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:38.460396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 41/80] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:38 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:38.464866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.466175 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.466992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.467920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.468488 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.469194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.563026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:38.573931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cdfcdf8f-c0ee-40f6-b8bd-6cffa51daa9c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.121360 Sep 28 07:24:38.574724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 40/81] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:38 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:38.827590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:38.828311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:38.834149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.834619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.835042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.835713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:38.836157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:38.836571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:38.967389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:38.975695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4be63b0-036e-4647-9bab-97a2c5dfd120 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.152499 Sep 28 07:24:38.976268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 42/82] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:38 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:39.383142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:39.383694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:39.390009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:39.390488 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:39.390917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:39.391606 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:39.392048 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:39.392455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:39.457769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:39.466031 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b4cb875d-77f7-4a85-a5fe-82efcf680d1b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.086742 Sep 28 07:24:39.466696 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 41/83] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:39 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:39.489788 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:39.490625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:39.498057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:39.498629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:39.499365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:39.500470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:39.501221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:39.501785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:39.566259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:39.576238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:39.577718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:39.578843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53d23639-289c-48d4-acfc-75819c441e5d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.093139 Sep 28 07:24:39.579693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 43/84] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:39 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:39.595634 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:39.596496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:39.602955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:39.608175 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:39.609023 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:39.610088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:39.610688 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:39.611265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:39.715782 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:39.733787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d5205187-53be-492d-8765-415fb269d9b0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.141849 Sep 28 07:24:39.734615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 42/85] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:39 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:40.000801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:40.001500 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:40.008466 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.009226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.009840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.010885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.011376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.012520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.167639 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:40.182063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5a1bdb3c-d2d2-409a-a694-083d0724147e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.185231 Sep 28 07:24:40.183008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 44/86] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:39 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:40.489801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:40.491378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:40.499502 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.500093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.500615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.501447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.502099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.502712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.575895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:40.584980 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2c003e63-6b61-4466-8e81-5839a14aa9df tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.099151 Sep 28 07:24:40.586095 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 43/87] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:40 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:40.609975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:40.611456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:40.623051 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.623556 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.623989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.624697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.625180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.625601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.716338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:40.728815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:40.730625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:40.731817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d5f25a2d-b264-4f73-98b1-b9a4589fceb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.129817 Sep 28 07:24:40.737331 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 45/88] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:40 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:40.763010 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:40.763822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:40.777762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.778612 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.779249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.779966 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:40.780450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:40.780878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:40.872240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:40.882254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2bc3f2bc-0343-4990-999a-8f8810ab5e45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.124020 Sep 28 07:24:40.883043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 44/89] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:40 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:41.206805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:41.207475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:41.213424 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.213906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.214339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.215062 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.215516 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.216092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.350528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:41.358783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e8719c31-8de4-481a-a001-978303bc4ba0 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.155833 Sep 28 07:24:41.359376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 46/90] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:41 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:41.611482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:41.612088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:41.618072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.618556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.619000 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.619659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.620103 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.620519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.682013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:41.689829 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6a0ff3b2-047c-4ddf-9a6b-6cf09af6effd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.082116 Sep 28 07:24:41.690373 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 45/91] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:41 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:41.756760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:41.757384 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:41.763609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.764076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.764499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.765272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.765715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.766141 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.826443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:41.834387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:41.835802 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:41.836875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bccc330b-6c33-4502-ae3d-cd963a8279fb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.084043 Sep 28 07:24:41.837455 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 47/92] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:41 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:41.906264 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:41.906871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:41.912753 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.913262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.913690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.914370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:41.914818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:41.915236 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:41.973935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:41.981602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3270c43c-471e-4aaf-ba55-a37e1e08656a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.079499 Sep 28 07:24:41.986764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 46/93] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:41 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:42.382697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:42.383305 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:42.389225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:42.389703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:42.390125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:42.390797 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:42.391246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:42.391658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:42.408853 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:42.520732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:42.528404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-16e3714c-94a2-4b46-a2fd-0b9d0add1aac tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.149514 Sep 28 07:24:42.528965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 48/94] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:42 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:42.714685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:42.715868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:42.721781 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:42.722269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:42.722695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:42.723376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:42.723821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:42.724234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:42.786299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:42.795005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-91fe2625-2d21-4935-b3da-a1be6ee9e74e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1289 microversion: 2.1 time: 0.084326 Sep 28 07:24:42.795576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 47/95] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:42 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:42.862304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:42.863001 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:42.868885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:42.869395 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:42.869825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:42.870501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:42.870949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:42.871416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:42.930068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:42.938240 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:42.939676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:42.940764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d600ee5-307e-4883-9ea9-22f70fc24ce7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.082310 Sep 28 07:24:42.941368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 49/96] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:42 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:43.004231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:43.005035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:43.007097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=8 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:43.013388 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:43.014145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:43.014579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:43.015271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:43.015742 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:43.016183 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:43.082342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:43.090231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c7661a51-7347-49de-994d-0b3f608c7bf6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1218 microversion: 2.1 time: 0.090121 Sep 28 07:24:43.090784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 48/97] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:42 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:43.552415 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:43.553094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:43.561545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:43.562537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:43.563129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:43.564676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:43.565306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:43.565875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:43.820369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:43.822626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:43.839144 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:43.840132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:43.840928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:43.842100 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:43.843708 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:43.845409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:43.901452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:43.982621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:43.992327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be96b404-3f2e-4ebb-8780-f394e4aae7c1 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.444457 Sep 28 07:24:43.993144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 50/98] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:43 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:44.018771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:44.019118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:44.019740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:44.032566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-47c4cc25-e030-4897-9630-b0997fcbae18 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1307 microversion: 2.1 time: 0.217909 Sep 28 07:24:44.038901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:44.038901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:44.042462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:44.043407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:44.044041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:44.044621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:44.050923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 49/99] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:43 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:44.115040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:44.115656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:44.135960 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:44.136232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:44.136420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:44.140178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:44.145301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:44.145955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:44.225633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:44.237684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:44.240422 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:44.241747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3fe2d85a-2329-45fd-9534-acb17e3c05ab tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1276 microversion: 2.20 time: 0.244351 Sep 28 07:24:44.242307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 51/100] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:43 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:44.320632 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:44.331344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b89735e5-118a-4f1d-b1b0-cad0efa2a75a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1274 microversion: 2.1 time: 0.221400 Sep 28 07:24:44.336243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 50/101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:44 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:45.019928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:45.021490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:45.029834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.030603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.031381 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.032261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.032887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.033509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.063039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:45.064554 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:45.078755 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.087519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.088168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.095112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.097976 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.101051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.271743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:45.288154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4de68750-41bf-482f-a197-7ac19f838fb5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1295 microversion: 2.1 time: 0.227485 Sep 28 07:24:45.294030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 51/102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:45 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:45.306241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:45.308435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:45.317088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.320033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.321869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.322615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.323085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.323638 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.368749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:45.389838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4af848ae-69e8-462d-9f08-744586dc2522 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.372790 Sep 28 07:24:45.392196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 52/103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:45 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:45.400009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:45.400910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:45.408151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.409032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.410028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.410941 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.411998 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.412987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.659560 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:45.667622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:45.674240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:45.675504 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6df92a49-4789-44f5-9117-9dff3c2f5aea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1332 microversion: 2.20 time: 0.380436 Sep 28 07:24:45.682663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 52/104] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:45 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:45.731391 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:45.743368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ccee36b-e7ec-4cc6-bb1e-ad72e243930e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1280 microversion: 2.1 time: 0.349771 Sep 28 07:24:45.745171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 53/105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:45 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:45.805706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-bb65cbd5-0dcd-4da0-9e86-25e31f1b9114 req-08de4f93-f39b-45b6-9cb7-7bd7a8e8e540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa762762-a21e-4513-8589-a928beda6b1d", "tag": "47aded81-579e-49a3-9036-c0619f14e849"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:45.822918 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bb65cbd5-0dcd-4da0-9e86-25e31f1b9114 req-08de4f93-f39b-45b6-9cb7-7bd7a8e8e540 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:45.823393 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bb65cbd5-0dcd-4da0-9e86-25e31f1b9114 req-08de4f93-f39b-45b6-9cb7-7bd7a8e8e540 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:45.823820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bb65cbd5-0dcd-4da0-9e86-25e31f1b9114 req-08de4f93-f39b-45b6-9cb7-7bd7a8e8e540 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:45.849337 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-bb65cbd5-0dcd-4da0-9e86-25e31f1b9114 req-08de4f93-f39b-45b6-9cb7-7bd7a8e8e540 service nova] Creating event network-changed:47aded81-579e-49a3-9036-c0619f14e849 for instance fa762762-a21e-4513-8589-a928beda6b1d on hv-cinder-85944 Sep 28 07:24:45.855313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-bb65cbd5-0dcd-4da0-9e86-25e31f1b9114 req-08de4f93-f39b-45b6-9cb7-7bd7a8e8e540 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171089 Sep 28 07:24:45.857355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 53/106] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:46.315312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:46.315969 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:46.322406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.323470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.324118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.325352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.326043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.326676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.414576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:46.415831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:46.422475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:46.424040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.424558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.425220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.425992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.426450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.427682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.431662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-defbfe44-61fd-4356-9405-8cfbd336884d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1295 microversion: 2.1 time: 0.120285 Sep 28 07:24:46.432749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 54/107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:46 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:46.716540 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:46.717227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:46.729945 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.730495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.732123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.732830 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.736491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.736491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.862309 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:46.872893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:46.874675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:46.876175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-41f72fb6-4fb9-412f-9f38-422ba66b69db tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1338 microversion: 2.20 time: 0.166869 Sep 28 07:24:46.876927 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 55/108] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:46 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1338 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:46.898386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:46.899605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:46.908198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.908692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.910814 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.912828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:46.913328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:46.913760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:46.946255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:46.978524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8fbec5dd-2a74-44b6-bf90-660c295502ff tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.566049 Sep 28 07:24:46.980876 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 54/109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:46 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:47.026160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:47.035815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff874082-8396-4e7e-9965-41902c8cf1e3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1280 microversion: 2.1 time: 0.157603 Sep 28 07:24:47.036565 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 56/110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:46 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:47.459324 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:47.460009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:47.467013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:47.467708 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:47.468144 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:47.469029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:47.469641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:47.470214 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:47.633004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:47.645946 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-10017ea8-935d-460f-a76c-d2767e96d46c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.190300 Sep 28 07:24:47.647065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 55/111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:47 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:47.907473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:47.908287 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:47.915119 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:47.915690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:47.916239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:47.918747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:47.919567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:47.920079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:47.994858 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:48.004151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:48.005006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:48.005717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:48.005967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:48.007150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-982d0acc-47e2-4a2e-88a8-e29c32bfdb74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1338 microversion: 2.20 time: 0.104994 Sep 28 07:24:48.008167 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 57/112] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:47 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:48.014279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:48.014766 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:48.015198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:48.015895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:48.016801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:48.017261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:48.063265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:48.063895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:48.077987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:48.078475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:48.078937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:48.079936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:48.080519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:48.081125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:48.181624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:48.191783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-20490ac9-8bef-4d6e-99d2-2c16a1af7ff6 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.191570 Sep 28 07:24:48.192961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 56/113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:47 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:48.245586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:48.254765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ad86444-55cc-4c23-94df-d10e8319a868 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.197338 Sep 28 07:24:48.255348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 58/114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:48 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:48.670219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:48.670832 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:48.677049 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:48.677532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:48.678136 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:48.678828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:48.679285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:48.679686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:48.855299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:48.865040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-800647c1-64f0-4cce-956f-388dbc454b62 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.199271 Sep 28 07:24:48.865665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 57/115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:48 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:49.033611 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:49.034219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:49.040048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.040522 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.041146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.041843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.042290 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.042930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.107282 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:49.115946 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:49.118765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:49.120068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ed725dc-9a0b-4cb0-b34f-c2462567bb05 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1338 microversion: 2.20 time: 0.090364 Sep 28 07:24:49.120769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 59/116] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:49 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:49.218058 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:49.218650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:49.225039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.225532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.225985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.226682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.227134 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.227556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.279307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:49.279921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:49.286605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.287103 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.287535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.288229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.288679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.289129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.396685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:49.405017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7fb8a15c-c99d-4689-b1fe-993058bce885 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.192286 Sep 28 07:24:49.405594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 58/117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:49 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:49.485412 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:49.494599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d99540e4-02da-42ec-b823-916926211592 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.219197 Sep 28 07:24:49.509880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 60/118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:49 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:49.888072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:49.889242 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:49.896234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.896823 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.897439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:49.898692 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:49.898879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:49.899825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.107773 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:50.118373 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fe4f63e7-d6cb-4950-a240-addc301416f1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.234540 Sep 28 07:24:50.123053 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 59/119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:49 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:50.146688 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:50.148148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:50.156567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:50.157325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:50.158907 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.160082 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:50.161506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:50.162402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.258378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:50.271951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:50.273842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:50.277164 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-59c0535e-d873-498d-9a1a-2d22b85e72cf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1338 microversion: 2.20 time: 0.133394 Sep 28 07:24:50.278353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 61/120] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:50 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:24:50.430874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:50.431614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:50.441216 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:50.442037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:50.442791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.443676 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:50.444532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:50.445207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.518503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:50.519544 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:50.529881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:50.530926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:50.531708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.533030 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:50.533778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:50.534395 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:50.814156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:50.829430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d01badf0-f2b8-4c46-9f97-900e12a48dae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.314561 Sep 28 07:24:50.840665 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 62/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:50 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:51.145617 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:51.146367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:51.152739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:51.154000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:51.154438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:51.155339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:51.155954 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:51.156377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:51.309618 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:51.321208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-112371c0-2fc8-43d9-b959-bed818e5676a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.179277 Sep 28 07:24:51.322505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 63/122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:51 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:51.332002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:51.342997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-72459caa-5d94-4ff9-b472-7805bb72968c tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.917638 Sep 28 07:24:51.343464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:51.344175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:51.344356 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:50 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:51.350916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:51.351528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:51.352059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:51.352883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:51.354542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:51.354542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:51.469856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:51.479537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:51.482852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:51.483985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46367ba5-c8e7-423c-894b-909af2c2dac8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1338 microversion: 2.20 time: 0.160183 Sep 28 07:24:51.485679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 64/124] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:51 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:51.859167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:51.859806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:51.878680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:51.879219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:51.879657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:51.883236 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:51.883584 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:51.884096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.326047 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:52.350750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:52.351425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:52.365780 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c88f85eb-6119-46f5-a3d6-2f9276aa301d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.510937 Sep 28 07:24:52.366672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 61/125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:51 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:52.367242 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:52.373012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:52.375631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.377173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:52.380641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:52.386288 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.391812 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:52.396275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:52.436528 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:52.437613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:52.439442 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.444892 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:52.446253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:52.449505 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.471439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:52.704269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:52.715708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-aa5e41be-8e64-4650-b623-6cf83433f4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.373381 Sep 28 07:24:52.717175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 65/126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:52 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:52.722513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:52.723428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:52.731191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:52.732143 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:52.732832 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.734015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:52.735394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:52.736173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:52.835268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:52.849640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:52.851826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:52.854297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b88864e4-56b9-4158-9c21-64309459bc80 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1338 microversion: 2.20 time: 0.134886 Sep 28 07:24:52.855459 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 66/127] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:52 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:53.053381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:53.065618 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-17cc1362-e455-497e-8ef9-c32935508c02 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.696779 Sep 28 07:24:53.066496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 62/128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:52 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:53.395869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:53.396992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:53.413182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:53.414634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:53.417418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:53.423388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:53.424779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:53.426413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:53.741733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:53.742182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:53.748311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:53.763074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-477d1dd1-345f-410e-8843-2c892533c0bc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.372515 Sep 28 07:24:53.771971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:53.772691 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:53.773102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 67/129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:53 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:53.773716 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:53.774888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:53.775636 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:53.778988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:53.883517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:53.884476 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:53.905476 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:53.906199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:53.906795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:53.907673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:53.908279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:53.908880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:54.357800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:54.387488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:54.401486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:54.410172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb681bff-5ecb-4683-ab83-f7f2c21dd680 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.530430 Sep 28 07:24:54.413172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 68/130] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:53 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:54.423361 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:54.424762 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:54.434306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:54.435607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:54.436417 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:54.438734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:54.439747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:54.440312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:54.659452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:54.667106 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7a2c34f0-8aad-4d7e-842f-69a0606a02e9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.929237 Sep 28 07:24:54.673541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 63/131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:53 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:54.679213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-2f5cd6ac-3a75-4f3a-8c81-2f427984b67d req-1f9ea49c-a4cb-4786-94da-8ec7e29c5554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e3e956-5f6c-45a6-856b-cea495f8a0c8", "tag": "2fcc55c9-f8c5-4280-ac79-26e52989b39d"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:54.709145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-2f5cd6ac-3a75-4f3a-8c81-2f427984b67d req-1f9ea49c-a4cb-4786-94da-8ec7e29c5554 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:54.709934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-2f5cd6ac-3a75-4f3a-8c81-2f427984b67d req-1f9ea49c-a4cb-4786-94da-8ec7e29c5554 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:54.710530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-2f5cd6ac-3a75-4f3a-8c81-2f427984b67d req-1f9ea49c-a4cb-4786-94da-8ec7e29c5554 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:54.739307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-2f5cd6ac-3a75-4f3a-8c81-2f427984b67d req-1f9ea49c-a4cb-4786-94da-8ec7e29c5554 service nova] Creating event network-changed:2fcc55c9-f8c5-4280-ac79-26e52989b39d for instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 on hv-cinder-85944 Sep 28 07:24:54.744428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:54.745168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-2f5cd6ac-3a75-4f3a-8c81-2f427984b67d req-1f9ea49c-a4cb-4786-94da-8ec7e29c5554 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070159 Sep 28 07:24:54.746188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 64/132] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:54.753823 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-473b81da-4ae7-4e7a-8e5f-532cc63b0864 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.337896 Sep 28 07:24:54.755582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 69/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:54 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:54.799406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:54.800525 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:54.811062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:54.812883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:54.813762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:54.815772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:54.816229 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:54.816650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.240890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3780a43-5882-4fed-90eb-bd39060f6d99", "name": "network-vif-plugged", "status": "completed", "tag": "648be1a4-0bc1-44aa-a1c5-4643d67519e4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:55.258702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.259465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.260111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.289519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Creating event network-vif-plugged:648be1a4-0bc1-44aa-a1c5-4643d67519e4 for instance d3780a43-5882-4fed-90eb-bd39060f6d99 on hv-cinder-85944 Sep 28 07:24:55.290392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 07:24:55.290976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f63f8f78-f950-4109-8d38-b681133ee2d7 req-ae85a6c5-6bd2-4c16-a2cb-61a29b2e382d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 07:24:55.292286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.293719 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.294492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.295430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.296083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.296725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.306809 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.compute.rpcapi [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 07:24:55.308031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] Releasing lock "compute-rpcapi-router" {{(pid=120452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 07:24:55.326397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3038b6ae-c168-4d20-929f-01935f1df575 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349712 Sep 28 07:24:55.327190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 70/134] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:24:55.440331 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:55.442036 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:55.452614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.455879 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.456346 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.457139 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.467933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.468655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.685411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:55.693833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b164d6ea-5ac0-47fd-8837-da76ca2e10fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.898647 Sep 28 07:24:55.705366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 65/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:54 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:55.710548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:55.711420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:55.723181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.723777 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.724776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.725085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.725762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.726396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.798453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:55.812131 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:55.814081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:55.815465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e9d1379-3cbd-4ec6-bba2-ecb099aaec9e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.379817 Sep 28 07:24:55.825486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 71/136] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:55 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:24:55.841755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:55.842668 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:55.850671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.851502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.852184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:55.853169 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:55.853881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:55.854504 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:56.056039 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:56.066331 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-51e1311d-b68f-48fb-80c7-14457bec20ef tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.237813 Sep 28 07:24:56.066910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 72/137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:55 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:56.575086 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:56.584929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c0cfb683-cd8f-45c1-9d9c-c02cbfb5f862 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.878140 Sep 28 07:24:56.586278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 66/138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:55 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:56.723017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:56.723739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:56.735377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:56.736199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:56.737460 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:56.739860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:56.741015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:56.742595 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:56.833449 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-81a1b738-5690-400b-9fae-1586730af98e req-3a745991-216a-462c-8b42-6b7d0556d210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475e52e8-57f8-4c53-b01d-52e19d35a1af", "tag": "b2a7b488-544e-4fa3-9375-a53ff209f778"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:56.864916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-81a1b738-5690-400b-9fae-1586730af98e req-3a745991-216a-462c-8b42-6b7d0556d210 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:56.865902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-81a1b738-5690-400b-9fae-1586730af98e req-3a745991-216a-462c-8b42-6b7d0556d210 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:56.866491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-81a1b738-5690-400b-9fae-1586730af98e req-3a745991-216a-462c-8b42-6b7d0556d210 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:56.892878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-81a1b738-5690-400b-9fae-1586730af98e req-3a745991-216a-462c-8b42-6b7d0556d210 service nova] Creating event network-changed:b2a7b488-544e-4fa3-9375-a53ff209f778 for instance 475e52e8-57f8-4c53-b01d-52e19d35a1af on hv-cinder-85944 Sep 28 07:24:56.900390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-81a1b738-5690-400b-9fae-1586730af98e req-3a745991-216a-462c-8b42-6b7d0556d210 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069930 Sep 28 07:24:56.901925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 67/139] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:24:56.919046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:56.919935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:56.928431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:56.929657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:56.931486 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:56.932277 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:56.932936 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:56.933419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:56.939658 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:24:57.041865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:57.054557 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-159f3aa6-918e-4b36-a274-949e25cb486f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.333352 Sep 28 07:24:57.056933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 73/140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:56 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:57.094209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:57.095054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:57.104257 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:57.108191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:57.110937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:57.112418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:57.113232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:57.113916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:57.273007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:57.284871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:57.286538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:57.295078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e31d6c6b-612a-49b8-961b-1c10048f3d58 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.384710 Sep 28 07:24:57.310156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 68/141] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:56 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:57.343659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-f89adb10-64d2-4bed-adee-8400e6d35c93 req-4aac5865-d392-4434-baed-4aec3266ac4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa762762-a21e-4513-8589-a928beda6b1d", "name": "network-vif-plugged", "status": "completed", "tag": "47aded81-579e-49a3-9036-c0619f14e849"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:57.391594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f89adb10-64d2-4bed-adee-8400e6d35c93 req-4aac5865-d392-4434-baed-4aec3266ac4b service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:57.394984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f89adb10-64d2-4bed-adee-8400e6d35c93 req-4aac5865-d392-4434-baed-4aec3266ac4b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:57.395572 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f89adb10-64d2-4bed-adee-8400e6d35c93 req-4aac5865-d392-4434-baed-4aec3266ac4b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:57.399423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:57.408890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4be25271-45d0-4d25-adb3-f78e72a5c9de tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.319957 Sep 28 07:24:57.411886 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 74/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:57 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:57.445294 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-f89adb10-64d2-4bed-adee-8400e6d35c93 req-4aac5865-d392-4434-baed-4aec3266ac4b service nova] Creating event network-vif-plugged:47aded81-579e-49a3-9036-c0619f14e849 for instance fa762762-a21e-4513-8589-a928beda6b1d on hv-cinder-85944 Sep 28 07:24:57.453461 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-f89adb10-64d2-4bed-adee-8400e6d35c93 req-4aac5865-d392-4434-baed-4aec3266ac4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114076 Sep 28 07:24:57.458740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 69/143] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:24:57.608960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:57.609518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:57.617045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:57.617732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:57.618340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:57.619176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:57.619771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:57.620336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:57.820272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:57.835901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0cb6dc7-c0a0-4e5e-b874-c23a6ac905ec tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.231858 Sep 28 07:24:57.836728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 75/144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:57 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:24:58.079267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:58.080069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:58.086685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.087167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.087598 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.088291 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.088739 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.101350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.323137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:58.325149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:58.345408 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.346110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.346712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.347947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.348892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.349491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.395167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:58.405043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-352d659d-8062-4cf8-aa6d-3fbc52221e04 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.329867 Sep 28 07:24:58.406185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 70/145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:58 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:58.437210 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:58.438429 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:58.447012 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.452582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.453408 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.454616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.454729 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.455116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.528508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:58.535891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:58.538561 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:58.540847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1668c6f4-d68c-40d9-8db5-3c5af4c65f59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.222490 Sep 28 07:24:58.541745 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 76/146] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:58 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:58.708205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:58.717577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-59082b42-fc5e-4add-a9b7-3f60bec4b4be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.284825 Sep 28 07:24:58.737146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 71/147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:58 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:58.861115 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:58.861845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:58.873665 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.874496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.875176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.876467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.877147 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.878063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.946377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-3992c8f3-5455-4860-a042-d7859f68938a req-bff1c85c-e4d8-409a-a43f-def5a9297948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:24:58.959418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3992c8f3-5455-4860-a042-d7859f68938a req-bff1c85c-e4d8-409a-a43f-def5a9297948 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:58.960133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3992c8f3-5455-4860-a042-d7859f68938a req-bff1c85c-e4d8-409a-a43f-def5a9297948 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:58.960712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3992c8f3-5455-4860-a042-d7859f68938a req-bff1c85c-e4d8-409a-a43f-def5a9297948 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:58.975465 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-3992c8f3-5455-4860-a042-d7859f68938a req-bff1c85c-e4d8-409a-a43f-def5a9297948 service nova] Creating event network-changed:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:24:58.984414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-3992c8f3-5455-4860-a042-d7859f68938a req-bff1c85c-e4d8-409a-a43f-def5a9297948 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041730 Sep 28 07:24:58.989096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 72/148] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:24:59.056498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:59.070368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c7f2563c-a08e-4923-bf19-10037aac1c66 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.212158 Sep 28 07:24:59.074932 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 77/149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:58 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:24:59.434287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:59.435810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:59.449093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:59.452859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:59.453675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:59.458092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:59.458769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:59.462302 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:59.565503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:59.567588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:59.576980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:59.577609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:59.578051 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:59.578750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:59.579373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:59.580093 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:59.783640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:59.804530 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:59.811643 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:24:59.815383 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dcfa260c-e944-411a-95e5-eaa7f2bc5417 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.251716 Sep 28 07:24:59.818837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 78/150] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:24:59 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:24:59.830271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:24:59.844794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:24:59.861316 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:59.862063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:59.862234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:24:59.862941 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:24:59.863428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:24:59.863880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:00.073051 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:00.083297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f3ad78a-db2f-48cb-b034-a4630546eddc tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.256815 Sep 28 07:25:00.085386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 79/151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:59 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:00.098193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:00.098962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:00.117355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:00.118458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:00.119061 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:00.119893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:00.120652 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:00.121736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:00.227166 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:00.243083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7a0a2116-c5f9-4218-9d84-924830a9dd39 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.814574 Sep 28 07:25:00.244131 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 73/152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:24:59 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:00.439119 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:00.449482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a559bc00-bedb-43f5-a286-9c136f5581bf tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.354327 Sep 28 07:25:00.453627 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 80/153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:00 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:00.849720 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:00.850727 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:00.861029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:00.862522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:00.863159 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:00.864184 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:00.864882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:00.865639 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.019085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:01.046774 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:01.052241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:01.054384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a834da98-b435-4a50-9b59-fe396927c6fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.213027 Sep 28 07:25:01.055272 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 74/154] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:00 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:01.114662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:01.116089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:01.124731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:01.125787 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:01.126371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.127451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:01.128058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:01.128667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.270686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:01.271139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:01.282192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:01.282683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:01.287816 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.288861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:01.291243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:01.291993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.373856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:01.388997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-45e8322a-60b6-4182-ba48-c82661f7c800 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.278970 Sep 28 07:25:01.390887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 81/155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:01 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:01.476425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:01.477132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:01.491246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:01.492212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:01.492903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.495517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:01.496210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:01.498959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:01.513815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:01.579651 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:01.587766 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-466768f5-2daa-4580-ace6-3ab9ee9f043e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.322078 Sep 28 07:25:01.594083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 75/156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:01 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:01.899496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:01.910234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7bbe091b-d44b-4e03-97cb-438b3b66c19d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.440110 Sep 28 07:25:01.912494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 82/157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:01 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:02.080295 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:02.080912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:02.090504 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.090949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.094363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.095127 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.095575 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.095997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.419213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:02.419948 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:02.430594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.431300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.432336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.433086 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.434267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.434681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.531694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:02.545912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:02.554450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:02.558881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e3b8af1f-f40b-4134-9539-774001f3970c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.481921 Sep 28 07:25:02.560840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 76/158] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:02 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:02.627831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:02.628532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:02.636797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.642807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.643682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.644774 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.645394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.645792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.662228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:02.671862 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cb7c6ba-1818-4c50-aa61-355500d77c57 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1315 microversion: 2.1 time: 0.259991 Sep 28 07:25:02.674661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 83/159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:02 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:02.864045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:02.876698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3b34ceca-6eed-4aa1-b0fa-3ab0a7130bcd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.253664 Sep 28 07:25:02.877637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 77/160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:02 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:02.935795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:02.937566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:02.946785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.947487 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.948122 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.949216 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.950227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.950957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.965066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-7a19145c-d4c4-4ca0-9a5a-eca4dbc6fb69 req-b82462c7-a23e-4bac-a9c0-ca8377fc815c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475e52e8-57f8-4c53-b01d-52e19d35a1af", "name": "network-vif-plugged", "status": "completed", "tag": "b2a7b488-544e-4fa3-9375-a53ff209f778"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:02.973099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=95 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:02.978002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-7a19145c-d4c4-4ca0-9a5a-eca4dbc6fb69 req-b82462c7-a23e-4bac-a9c0-ca8377fc815c service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:02.978698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-7a19145c-d4c4-4ca0-9a5a-eca4dbc6fb69 req-b82462c7-a23e-4bac-a9c0-ca8377fc815c service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:02.979348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-7a19145c-d4c4-4ca0-9a5a-eca4dbc6fb69 req-b82462c7-a23e-4bac-a9c0-ca8377fc815c service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:02.993970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-7a19145c-d4c4-4ca0-9a5a-eca4dbc6fb69 req-b82462c7-a23e-4bac-a9c0-ca8377fc815c service nova] Creating event network-vif-plugged:b2a7b488-544e-4fa3-9375-a53ff209f778 for instance 475e52e8-57f8-4c53-b01d-52e19d35a1af on hv-cinder-85944 Sep 28 07:25:03.000747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-7a19145c-d4c4-4ca0-9a5a-eca4dbc6fb69 req-b82462c7-a23e-4bac-a9c0-ca8377fc815c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040284 Sep 28 07:25:03.001952 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 78/161] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:25:03.135199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:03.147497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9cf09a20-eb1c-4dc7-aa0d-5757f4170398 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.215778 Sep 28 07:25:03.148208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 84/162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:02 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:03.588765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:03.590157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:03.607923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:03.608911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:03.614663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:03.615760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:03.616467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:03.617128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:03.706671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:03.707031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:03.718056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:03.720446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:03.720978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:03.722819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:03.724674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:03.726251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:03.993244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:04.002471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b55a2192-ba56-40bd-aeb6-11acf4e8c989 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1502 microversion: 2.1 time: 0.301917 Sep 28 07:25:04.003780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 85/163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:03 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:04.019685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:04.020313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:04.029659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:04.030276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:04.030715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:04.031427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:04.031880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:04.032448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:04.314710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:04.327506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c8f738d6-87e9-472d-9bb9-33cee77e9c75 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.322490 Sep 28 07:25:04.330385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 86/164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:04 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:04.352635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:04.352820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:04.353274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:04.362642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:04.364681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:04.368688 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:04.371557 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-60c85e82-c66e-4ac1-bf86-b71b422380d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.786574 Sep 28 07:25:04.373090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 79/165] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:03 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:04.386520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:04.395350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:04.396590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:04.398021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:04.398712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:04.399287 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:04.610247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:04.622017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10e04298-f36b-4472-8a22-fe41d5107e22 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.290087 Sep 28 07:25:04.622862 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 87/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:04 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:05.036838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-d5128e4b-9eab-4650-8067-2af946427a86 req-a46c9f04-1a83-4aae-a15d-28032adf97c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e3e956-5f6c-45a6-856b-cea495f8a0c8", "name": "network-vif-plugged", "status": "completed", "tag": "2fcc55c9-f8c5-4280-ac79-26e52989b39d"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:05.048268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-d5128e4b-9eab-4650-8067-2af946427a86 req-a46c9f04-1a83-4aae-a15d-28032adf97c7 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.048992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-d5128e4b-9eab-4650-8067-2af946427a86 req-a46c9f04-1a83-4aae-a15d-28032adf97c7 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.049664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-d5128e4b-9eab-4650-8067-2af946427a86 req-a46c9f04-1a83-4aae-a15d-28032adf97c7 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.064442 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-d5128e4b-9eab-4650-8067-2af946427a86 req-a46c9f04-1a83-4aae-a15d-28032adf97c7 service nova] Creating event network-vif-plugged:2fcc55c9-f8c5-4280-ac79-26e52989b39d for instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 on hv-cinder-85944 Sep 28 07:25:05.070601 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-d5128e4b-9eab-4650-8067-2af946427a86 req-a46c9f04-1a83-4aae-a15d-28032adf97c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037512 Sep 28 07:25:05.071550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 80/167] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:25:05.352397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:05.353074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:05.356899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:05.360866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.361667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.362461 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.363489 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.364213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.365276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.404067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:05.405050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:05.412771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.413639 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.414213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.415052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.415664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.416971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.556923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:05.566580 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5bce6ef-da9f-46bf-bb4d-62eecdda982b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.218142 Sep 28 07:25:05.567409 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 88/168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:05 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:05.600335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:05.608734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:05.610209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:05.611304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-16199032-b4c7-44d8-ba07-7a911c7610c1 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.213360 Sep 28 07:25:05.611847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 81/169] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:05 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:05.649191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:05.649994 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:05.656557 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.657068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.657501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.658367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:05.658828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:05.659248 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:05.813949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:05.825152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a30a5a22-17cc-4784-926c-0a9efa562867 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.180358 Sep 28 07:25:05.825910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 89/170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:05 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:06.591548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:06.592197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:06.598962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:06.599455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:06.600083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:06.601323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:06.601923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:06.602920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:06.641301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:06.643106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:06.654630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:06.656447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:06.657335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:06.659368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:06.660571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:06.661235 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:06.801994 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:06.810452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-be36cddb-50bc-472c-9631-0138513c29d6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.223832 Sep 28 07:25:06.811656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 82/171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:06 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:06.850497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:06.851109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:06.859792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:06.860294 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:06.860755 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:06.865932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:06.866650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:06.867271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:07.138584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:07.154744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:07.162071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:07.164837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9b77821-8e6e-498f-b6de-a834d5850891 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.529960 Sep 28 07:25:07.169017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 90/172] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:06 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:25:07.350353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:07.351592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4bc5f15a-f9ba-48cf-af68-14cb332b9323 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.504852 Sep 28 07:25:07.354590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 83/173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:06 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:07.836450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:07.838314 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:07.849632 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:07.851219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:07.851953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:07.853500 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:07.854805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:07.856738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:07.993142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7185b9df-2fa0-4f9e-aefd-83193c7ac937"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:07.997284 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:08.010693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:08.013464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:08.013912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:08.024422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:08.026776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:08.028050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:08.115101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:08.126707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46edcc33-bab6-4e50-9dcc-27d0c134f5b8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.296060 Sep 28 07:25:08.127892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 91/174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:07 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:08.203562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:08.204272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:08.223977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:08.226397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:08.228033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:08.228819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:08.229570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:08.230760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:08.386420 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:08.397997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:08.401428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:08.401428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-495a19ef-225c-4403-a0c4-5f7d56b815d6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.202338 Sep 28 07:25:08.403999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 92/175] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:08 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:08.409728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:08.410537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:08.416443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:08.416857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:08.417323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:08.418944 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:08.419579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:08.419996 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:08.669692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:08.681724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbc87455-965a-4245-920b-2ca1ba66de19 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1361 microversion: 2.1 time: 0.276530 Sep 28 07:25:08.682588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 93/176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:08 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:09.156893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:09.157544 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:09.170779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.171794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.174653 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.175682 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.176045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.177993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.342684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:09.350478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6f31d536-6376-4062-9107-a2e72f44ae31 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.197683 Sep 28 07:25:09.351057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 94/177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:09 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:09.356666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b8954c3a-6552-4a90-9ff1-52bf74944403 req-03cee113-a812-4776-acbb-6d6d7c20e0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "name": "network-vif-plugged", "status": "completed", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:09.370153 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b8954c3a-6552-4a90-9ff1-52bf74944403 req-03cee113-a812-4776-acbb-6d6d7c20e0ec service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.371386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b8954c3a-6552-4a90-9ff1-52bf74944403 req-03cee113-a812-4776-acbb-6d6d7c20e0ec service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.371891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b8954c3a-6552-4a90-9ff1-52bf74944403 req-03cee113-a812-4776-acbb-6d6d7c20e0ec service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.385770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b8954c3a-6552-4a90-9ff1-52bf74944403 req-03cee113-a812-4776-acbb-6d6d7c20e0ec service nova] Creating event network-vif-plugged:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:25:09.391358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b8954c3a-6552-4a90-9ff1-52bf74944403 req-03cee113-a812-4776-acbb-6d6d7c20e0ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038992 Sep 28 07:25:09.391947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 95/178] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:25:09.432661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:09.434524 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:09.441038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.441525 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.441957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.442640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.443094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.443511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.589664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:09.598763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:09.600183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:09.601369 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4326ecdc-fe38-4cbf-98a2-fa98486d02eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.173597 Sep 28 07:25:09.601947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 96/179] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:09 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:25:09.713642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:09.714990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:09.722250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.723690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.724214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.725215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.725940 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.726453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.907873 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:09.917340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53a7768a-3796-4b29-b37b-e7a629c0621d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1546 microversion: 2.1 time: 0.214273 Sep 28 07:25:09.918750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 97/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:09 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:09.946934 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:09.947618 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:09.955027 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.955748 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.956326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.957236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:09.958122 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:09.958682 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:09.977769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0f869d1b-0539-4579-a9af-c840a171ee5d tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "POST /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.988714 Sep 28 07:25:09.981397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 84/181] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:25:07 2022] POST /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d/os-volume_attachments => generated 194 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:25:10.122419 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71c13b13-3d9f-4015-a8a5-ad0041c4c72b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184187 Sep 28 07:25:10.123010 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 98/182] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:25:09 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:25:10.384594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:10.385316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:10.399694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:10.401228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:10.403892 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:10.405902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:10.406793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:10.407933 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:10.628704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:10.631385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:10.640605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:10.641339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:10.641989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:10.643362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:10.643949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:10.644703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:10.816827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:10.835550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7109a33e-c4f1-4fe7-bb32-f11a42dc910f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1322 microversion: 2.1 time: 0.456308 Sep 28 07:25:10.848971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 85/183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:10 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:10.876607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:10.880417 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:10.891202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:10.894542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:10.896337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-07cd5c6b-ebb1-4c93-a4d0-01e9d449b9bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.272105 Sep 28 07:25:10.897059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 99/184] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:10 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:25:11.860583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:11.861340 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:11.872384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:11.872838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:11.873338 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:11.874088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:11.874539 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:11.874959 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:11.908885 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:11.926596 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:11.927206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:11.937400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:11.938090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:11.938678 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:11.939538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:11.940011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:11.940474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:12.227404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:12.236905 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:12.248378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:12.249553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c597a277-6ead-469d-986c-38535835b247 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1406 microversion: 2.20 time: 0.329873 Sep 28 07:25:12.250175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 100/185] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:11 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:12.463243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:12.465901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-1edbda25-8375-4f6f-b815-6a0de02ffa02 req-5f400f0e-2b08-4015-bc2b-f8b628c2271f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475e52e8-57f8-4c53-b01d-52e19d35a1af", "tag": "b2a7b488-544e-4fa3-9375-a53ff209f778"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:12.477644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8fb7ac3d-b066-4c8d-9439-22d162baac23 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1516 microversion: 2.1 time: 0.622606 Sep 28 07:25:12.480924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1edbda25-8375-4f6f-b815-6a0de02ffa02 req-5f400f0e-2b08-4015-bc2b-f8b628c2271f service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:12.481817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1edbda25-8375-4f6f-b815-6a0de02ffa02 req-5f400f0e-2b08-4015-bc2b-f8b628c2271f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:12.482454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-1edbda25-8375-4f6f-b815-6a0de02ffa02 req-5f400f0e-2b08-4015-bc2b-f8b628c2271f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:12.501418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 86/186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:11 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1516 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:12.508007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:12.510766 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:12.534670 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-1edbda25-8375-4f6f-b815-6a0de02ffa02 req-5f400f0e-2b08-4015-bc2b-f8b628c2271f service nova] Creating event network-changed:b2a7b488-544e-4fa3-9375-a53ff209f778 for instance 475e52e8-57f8-4c53-b01d-52e19d35a1af on hv-cinder-85944 Sep 28 07:25:12.536437 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:12.542769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:12.543307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:12.544066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:12.544538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:12.549566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:12.561492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-1edbda25-8375-4f6f-b815-6a0de02ffa02 req-5f400f0e-2b08-4015-bc2b-f8b628c2271f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099970 Sep 28 07:25:12.562192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 101/187] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:25:12.654910 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'flavor' on Instance uuid 48e3e956-5f6c-45a6-856b-cea495f8a0c8 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:25:12.912389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-14addd07-84bc-400f-9de3-749e4ef2413b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8/action" status: 200 len: 32 microversion: 2.1 time: 0.407020 Sep 28 07:25:12.913677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 87/188] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:25:12 2022] POST /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8/action => generated 32 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:25:12.926348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:12.927595 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:12.936203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:12.937264 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:12.938087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:12.939228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:12.939864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:12.940681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:13.175532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:13.190419 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-02e60750-e6f8-4623-b168-2c3d92923979 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.270550 Sep 28 07:25:13.191820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 102/189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:12 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:13.280705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:13.281776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:13.291080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:13.291780 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:13.292219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:13.294151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:13.294868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:13.295584 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:13.623200 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:13.632476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:13.634057 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:13.635308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2c6ad71d-94d2-45a4-8275-7c5cd7cdb085 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1599 microversion: 2.20 time: 0.361592 Sep 28 07:25:13.635931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 88/190] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:25:13 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1599 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:25:13.665185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:13.665865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:13.674053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:13.674792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:13.675300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:13.676217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:13.676857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:13.677512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:13.826922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-65d1641e-6434-455d-8369-3c823deffc52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.165744 Sep 28 07:25:13.827541 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 103/191] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Sep 28 07:25:13 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:25:14.215784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:14.217196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:14.227753 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:14.229162 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:14.229900 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:14.232664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:14.233355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:14.233995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:14.661331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:14.665665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c5bb215f-544a-4bbf-a90b-8e70856e0e7f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.454452 Sep 28 07:25:14.669685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 89/192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:14 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:15.697452 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:15.700984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:15.711068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:15.711766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:15.712368 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:15.713945 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:15.715184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:15.715758 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:15.873109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:15.880974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9af93a1f-61e2-4849-9240-969d529c348f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.189697 Sep 28 07:25:15.881765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 104/193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:15 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:16.091434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-6b066009-5559-47a1-908a-33ec36df32e5 req-1c38cf58-45d0-4ae3-be3b-3df5bf5c608e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:16.103665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-6b066009-5559-47a1-908a-33ec36df32e5 req-1c38cf58-45d0-4ae3-be3b-3df5bf5c608e service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:16.104139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-6b066009-5559-47a1-908a-33ec36df32e5 req-1c38cf58-45d0-4ae3-be3b-3df5bf5c608e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:16.104595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-6b066009-5559-47a1-908a-33ec36df32e5 req-1c38cf58-45d0-4ae3-be3b-3df5bf5c608e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:16.116413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-6b066009-5559-47a1-908a-33ec36df32e5 req-1c38cf58-45d0-4ae3-be3b-3df5bf5c608e service nova] Creating event network-changed:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:25:16.123853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-6b066009-5559-47a1-908a-33ec36df32e5 req-1c38cf58-45d0-4ae3-be3b-3df5bf5c608e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036871 Sep 28 07:25:16.124503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 90/194] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:25:16.904729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:16.905635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:16.916005 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:16.916621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:16.919259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:16.920376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:16.921181 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:16.921675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:17.095055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:17.104248 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd925b83-0fc2-4821-af78-7f47c1e2e9d0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.204052 Sep 28 07:25:17.105185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 105/195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:16 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:18.128508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:18.129234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:18.135330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:18.135813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:18.136264 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:18.136934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:18.137400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:18.137837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:18.293215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:18.300804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4c1629ed-59a4-4a3f-8089-89c8201f4732 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.177080 Sep 28 07:25:18.301389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 91/196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:18 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:19.325086 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:19.325690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:19.331560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:19.332035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:19.332460 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:19.333243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:19.345156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:19.345156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:19.462509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:19.470177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4084c6f-d86a-47d1-9d20-0110f1d560be tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.149509 Sep 28 07:25:19.470736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 106/197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:19 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:20.492805 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:20.493440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:20.499823 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:20.500301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:20.500728 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:20.501436 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:20.501912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:20.502337 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:20.626255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:20.633814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-35ed4c63-94b4-489d-993f-b3755e8166f2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.144828 Sep 28 07:25:20.634369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 92/198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:20 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:21.657821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:21.658449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:21.664348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:21.664848 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:21.665310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:21.665985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:21.666427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:21.666837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:21.807569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:21.815357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-141b2ba6-75c0-4066-b06b-e1e9f8445688 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.161309 Sep 28 07:25:21.815914 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 107/199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:21 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:22.838355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:22.839291 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:22.846174 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:22.846654 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:22.847085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:22.847775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:22.848224 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:22.848647 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:22.997650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:23.005550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e4a10d78-e9bd-4600-9227-1fefe8f941db tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.171359 Sep 28 07:25:23.007020 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 93/200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:22 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:23.138363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:23.138882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:23.145315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:23.145801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:23.146231 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:23.146927 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:23.147376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:23.147798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:23.173940 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:25:23.264351 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-68aefea5-9c14-4fb2-b813-80fc55ba1294 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 204 len: 0 microversion: 2.1 time: 0.130469 Sep 28 07:25:23.265032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 108/201] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:25:23 2022] DELETE /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:25:23.273270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:23.274046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:23.280874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:23.281628 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:23.282255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:23.283165 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:23.283594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:23.284033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:23.416490 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:23.425842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6c684024-e106-4986-bb28-b37316f83169 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1554 microversion: 2.1 time: 0.156548 Sep 28 07:25:23.426427 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 94/202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:23 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:24.032092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:24.032869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:24.038743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:24.039312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:24.039804 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:24.040545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:24.041015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:24.041432 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:24.209672 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:24.219166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-69bbf628-192c-46c5-a9e4-f2e5fd6a5b86 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.191187 Sep 28 07:25:24.224980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 109/203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:24 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:24.448970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:24.449989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:24.456735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:24.457257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:24.457696 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:24.458404 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:24.458863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:24.459287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:24.610292 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:24.623820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-219deaff-8984-41ba-8e37-9ae8699636be tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1554 microversion: 2.1 time: 0.179140 Sep 28 07:25:24.624984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 95/204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:24 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:25.247730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:25.248531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:25.254508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:25.254987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:25.255416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:25.256103 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:25.256555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:25.256990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:25.391610 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:25.399226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b49355fe-b450-45ab-84c5-2a86aecb0a55 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.155515 Sep 28 07:25:25.399788 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 110/205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:25 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:25.647533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:25.648142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:25.654694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:25.655202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:25.655633 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:25.656320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:25.656767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:25.657210 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:25.788098 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:25.797660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-26631922-a896-4643-9fac-a45599a67f47 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1554 microversion: 2.1 time: 0.153679 Sep 28 07:25:25.797978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 96/206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:25 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:26.421344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:26.421951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:26.427889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:26.428357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:26.428781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:26.429492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:26.429931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:26.430339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:26.559768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:26.567427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fa1d880c-49f7-41a6-8164-baef5c93d826 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.149903 Sep 28 07:25:26.567987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 111/207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:26 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:26.821402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:26.822004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:26.828380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:26.828856 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:26.829316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:26.829992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:26.830436 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:26.830850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:26.962352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:26.971231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1baa52bf-ff5f-461c-992d-28aa5b4dd534 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1554 microversion: 2.1 time: 0.153842 Sep 28 07:25:26.971787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 97/208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:26 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:27.592822 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:27.593800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:27.598310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-6894793c-a61c-4a71-8cef-327a140b3d78 req-926ccaea-2174-46f4-bb2f-3e00d32b0b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa762762-a21e-4513-8589-a928beda6b1d", "name": "network-vif-deleted", "tag": "47aded81-579e-49a3-9036-c0619f14e849"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:25:27.601952 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:27.602443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:27.602870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:27.603570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:27.604023 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:27.604475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:27.608201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-6894793c-a61c-4a71-8cef-327a140b3d78 req-926ccaea-2174-46f4-bb2f-3e00d32b0b9e service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:27.609407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-6894793c-a61c-4a71-8cef-327a140b3d78 req-926ccaea-2174-46f4-bb2f-3e00d32b0b9e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:27.610160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-6894793c-a61c-4a71-8cef-327a140b3d78 req-926ccaea-2174-46f4-bb2f-3e00d32b0b9e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:27.623227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-6894793c-a61c-4a71-8cef-327a140b3d78 req-926ccaea-2174-46f4-bb2f-3e00d32b0b9e service nova] Creating event network-vif-deleted:47aded81-579e-49a3-9036-c0619f14e849 for instance fa762762-a21e-4513-8589-a928beda6b1d on hv-cinder-85944 Sep 28 07:25:27.628386 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-6894793c-a61c-4a71-8cef-327a140b3d78 req-926ccaea-2174-46f4-bb2f-3e00d32b0b9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Sep 28 07:25:27.629651 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 98/209] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:25:27.751990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:27.759853 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83ff183f-49c4-4fc8-89cd-bae18a94839b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.172251 Sep 28 07:25:27.760408 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 112/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:27 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:27.996506 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:27.997096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:28.003160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:28.003635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:28.004062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:28.004741 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:28.005212 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:28.005629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:28.068754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0983c1e9f7649c2890000959cea452b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416f25107a0d4eb0bab9d92e59cf07f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:28.078073 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bc4c700b-a1f6-4f19-b176-2eaba1c7142e tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 200 len: 1346 microversion: 2.1 time: 0.086409 Sep 28 07:25:28.078647 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 99/211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:27 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:28.782942 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:28.783540 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:28.789650 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:28.790137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:28.790575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:28.791278 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:28.791730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:28.792692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:28.934365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:28.942174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-495de9e7-28b3-4d3d-a3e3-2abee8ac3ff7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.163072 Sep 28 07:25:28.942746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 113/212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:28 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:25:29.103747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:29.104306 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:29.113339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:29.113819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:29.114250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:29.114943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:29.115387 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:29.115804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:29.130178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] HTTP exception thrown: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Request method failure captured: Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d HTTP/1.1 Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_afCsuuTSvsMJN7toO1HHeoBUhGKrMDebRodw7ZTEjZLlrTXl8-WALogihlpL7U1qUA2q-AuXwWvF-LehM3eak9l6bNn38mgcUniT3GRqae6sh9kwRdFI5qxDHBw4hNnVdov6IKUuwgUWTOZu2gHEeRdf-cWMT8L9pqAJQK6YEI87c Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:25:29.134990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_416f25107a0d4eb0bab9d92e59cf07f4", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: c0983c1e9f7649c2890000959cea452b Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.136319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'fa762762-a21e-4513-8589-a928beda6b1d'} Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:25:29.137017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.138314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.139540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Returning 404 to user: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:25:29.139540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b5002dd1-c9f6-4da2-9001-01bdb894c562 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 404 len: 111 microversion: 2.1 time: 0.036641 Sep 28 07:25:29.139540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 100/213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:29 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:25:29.253056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:29.255260 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:29.261177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:29.261659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:29.262091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:29.262769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:29.263215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:29.263629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:29.275821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] HTTP exception thrown: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Request method failure captured: Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d/os-volume_attachments HTTP/1.1 Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_afCsuuTSvsMJN7toO1HHeoBUhGKrMDebRodw7ZTEjZLlrTXl8-WALogihlpL7U1qUA2q-AuXwWvF-LehM3eak9l6bNn38mgcUniT3GRqae6sh9kwRdFI5qxDHBw4hNnVdov6IKUuwgUWTOZu2gHEeRdf-cWMT8L9pqAJQK6YEI87c Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:25:29.280714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_416f25107a0d4eb0bab9d92e59cf07f4", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: c0983c1e9f7649c2890000959cea452b Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.282221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'server_id': 'fa762762-a21e-4513-8589-a928beda6b1d'} Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:25:29.282913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:29.284020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:29.285211 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Returning 404 to user: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:25:29.285211 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-040cf9a9-f015-4300-bf43-9edaa56f77d8 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033097 Sep 28 07:25:29.285211 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 114/214] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:25:29 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:25:29.965617 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:29.966227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:29.972047 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:29.972524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:29.972988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:29.973655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:29.974107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:29.974543 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:30.106919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:30.114765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-77b60c45-6ccc-4476-803b-71a8a1bd2e05 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.153586 Sep 28 07:25:30.115332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 101/215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:29 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:30.495767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:30.496255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:30.502931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:30.503403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:30.503832 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:30.504506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:30.504984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:30.505399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:30.518638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] HTTP exception thrown: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Request method failure captured: Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d HTTP/1.1 Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_afCsuuTSvsMJN7toO1HHeoBUhGKrMDebRodw7ZTEjZLlrTXl8-WALogihlpL7U1qUA2q-AuXwWvF-LehM3eak9l6bNn38mgcUniT3GRqae6sh9kwRdFI5qxDHBw4hNnVdov6IKUuwgUWTOZu2gHEeRdf-cWMT8L9pqAJQK6YEI87c Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:25:30.520760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_416f25107a0d4eb0bab9d92e59cf07f4", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: c0983c1e9f7649c2890000959cea452b Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.522145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'fa762762-a21e-4513-8589-a928beda6b1d'} Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:25:30.522930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.524182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.525480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Returning 404 to user: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:25:30.525480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40c4d7ed-8a1d-4472-81e7-4ca7818b6c7a tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 404 len: 111 microversion: 2.1 time: 0.030345 Sep 28 07:25:30.525480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 115/216] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:25:30 2022] DELETE /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:25:30.533814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:30.535453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] [instance: fa762762-a21e-4513-8589-a928beda6b1d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:30.541313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:30.541783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:30.542203 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:30.542873 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:30.543314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:30.543725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:30.557791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] HTTP exception thrown: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Request method failure captured: Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d HTTP/1.1 Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_afCsuuTSvsMJN7toO1HHeoBUhGKrMDebRodw7ZTEjZLlrTXl8-WALogihlpL7U1qUA2q-AuXwWvF-LehM3eak9l6bNn38mgcUniT3GRqae6sh9kwRdFI5qxDHBw4hNnVdov6IKUuwgUWTOZu2gHEeRdf-cWMT8L9pqAJQK6YEI87c Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:25:30.560594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/416f25107a0d4eb0bab9d92e59cf07f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_416f25107a0d4eb0bab9d92e59cf07f4", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 416f25107a0d4eb0bab9d92e59cf07f4 Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-DeleteServersTestJSON-573000582 Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: c0983c1e9f7649c2890000959cea452b Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-DeleteServersTestJSON-573000582-project Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.561948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'fa762762-a21e-4513-8589-a928beda6b1d'} Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:25:30.562619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. Sep 28 07:25:30.563642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:25:30.564917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] Returning 404 to user: Instance fa762762-a21e-4513-8589-a928beda6b1d could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:25:30.564917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3ec46cef-8876-4cd9-ba96-c7fd23f171e7 tempest-DeleteServersTestJSON-573000582 tempest-DeleteServersTestJSON-573000582-project] 10.222.0.52 "GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d" status: 404 len: 111 microversion: 2.1 time: 0.032576 Sep 28 07:25:30.564917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 102/217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:30 2022] GET /compute/v2.1/servers/fa762762-a21e-4513-8589-a928beda6b1d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:25:31.139267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:31.139974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:31.146534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:31.147049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:31.147468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:31.148181 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:31.148636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:31.149089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:31.298958 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:31.312346 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cefd09a9-9850-46f3-9824-2bf810cd3d74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.177882 Sep 28 07:25:31.313283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 116/218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:31 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:32.335722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:32.336330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:32.343467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:32.343949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:32.344590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:32.345317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:32.345916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:32.346517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:32.372775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:32.568096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:32.582247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4caaf753-97d5-4b66-b2a5-91e293fa9b24 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.250331 Sep 28 07:25:32.595090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 103/219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:32 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:33.609696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:33.610753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:33.617366 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:33.618082 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:33.618692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:33.619562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:33.620158 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:33.620781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:33.625630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:33.859350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:33.869493 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3440e006-24cd-4d5d-a298-3cf9bc10ac6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.265604 Sep 28 07:25:33.870078 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 117/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:33 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:34.895241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:34.895934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:34.899058 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=52 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:34.905840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:34.906955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:34.907588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:34.908277 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:34.908875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:34.909353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:35.079415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:35.087822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-33ecc0ae-647c-40da-87d7-118e5d4c62e5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.198554 Sep 28 07:25:35.088485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 104/221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:34 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:36.112153 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:36.112756 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:36.118445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:25:36.120387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:36.121429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:36.121789 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:36.122688 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:36.123280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:36.123697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:36.334966 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:36.347495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-225527d5-85b7-4040-a198-287b98ad80ef tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.239527 Sep 28 07:25:36.349233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 118/222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:36 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:37.373242 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:37.374412 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:37.381524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:37.382132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:37.382569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:37.383266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:37.383717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:37.384169 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:37.516681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:37.524468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-095ab078-8cea-4507-8966-fd295bd9212a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.156744 Sep 28 07:25:37.525050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 105/223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:37 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:38.548040 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:38.548712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:38.554594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:38.555070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:38.555493 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:38.556427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:38.556866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:38.557298 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:38.696843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:38.705532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7f840a0d-4210-4326-98a2-dd8e1c942a0c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.161952 Sep 28 07:25:38.706105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 119/224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:38 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:39.729911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:39.730514 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:39.737761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:39.738243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:39.738675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:39.739366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:39.739820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:39.740240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:39.868248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:39.876112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fec05f5e-351e-4cbe-98f5-0cd0351821fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.150000 Sep 28 07:25:39.876678 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 106/225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:39 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:40.899377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:40.899867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:40.905922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:40.906400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:40.906826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:40.907543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:40.908273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:40.908689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:41.042128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:41.050508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-55ef2ebf-451e-4fe8-a8a3-dca3bac7e48d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.154885 Sep 28 07:25:41.051360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 120/226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:40 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:42.074093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:42.074838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:42.081731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:42.082220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:42.082657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:42.083382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:42.083838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:42.084264 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:42.218767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:42.227355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5ad46c1a-9647-41ca-85c2-346251d7c08e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.157193 Sep 28 07:25:42.227916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 107/227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:42 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:43.250101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:43.250708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:43.256407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:43.256881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:43.257336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:43.258006 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:43.258449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:43.258862 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:43.397451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:43.405632 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-14d2f5e0-189e-4830-abf1-85d1c7be89f6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.159377 Sep 28 07:25:43.406298 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 121/228] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:43 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:44.429454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:44.430062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:44.436822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:44.437520 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:44.438018 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:44.438726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:44.439177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:44.439603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:44.566220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:44.573926 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6d176bd3-a3f0-444e-b718-f0cc7a4fa102 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.148352 Sep 28 07:25:44.574622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 108/229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:44 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:45.597939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:45.598575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:45.604379 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:45.604855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:45.605316 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:45.605995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:45.606444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:45.607441 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:45.736257 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:45.743872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-214731f6-0c0f-40ec-9826-19b7e9b2da47 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.149794 Sep 28 07:25:45.744472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 122/230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:45 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:46.766912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:46.767518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:46.773970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:46.774530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:46.774958 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:46.775629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:46.776079 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:46.776492 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:46.906903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:46.914389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1d62dc34-502c-4bf9-a14b-6940732f26f3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.151735 Sep 28 07:25:46.914947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 109/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:46 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:47.937185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:47.937785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:47.943702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:47.944180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:47.944608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:47.945318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:47.945770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:47.946183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:48.074677 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:48.082940 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ba3d863-6388-45ab-8927-2de1fffa636d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.150116 Sep 28 07:25:48.083508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 123/232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:47 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:49.105837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:49.106365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:49.112682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:49.113187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:49.113615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:49.114293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:49.114736 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:49.115153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:49.239561 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:49.247171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-375dcc08-96a6-4d4b-a3ee-fbab19f719ee tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.145309 Sep 28 07:25:49.247747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 110/233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:49 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:50.270163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:50.270709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:50.276565 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:50.277093 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:50.277528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:50.278197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:50.278644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:50.279052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:50.406216 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:50.413812 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7965f151-678a-45f5-a44f-6d42f88a7115 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.148090 Sep 28 07:25:50.414360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 124/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:50 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:51.435610 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:51.436906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:51.443651 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:51.444131 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:51.444562 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:51.445273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:51.445729 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:51.446146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:51.798764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:51.806762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-415e2e69-b838-4db8-be7a-72c8b8b7b373 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.374974 Sep 28 07:25:51.807321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 111/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:51 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:52.829894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:52.830523 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:52.836432 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:52.836910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:52.837360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:52.838038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:52.838512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:52.838925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:52.964713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:52.972393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b0995924-fa7a-405b-b4ab-512a3344093e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.146751 Sep 28 07:25:52.973015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 125/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:52 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:53.996752 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:53.997622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:54.017206 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:54.017699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:54.018133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:54.018839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:54.019410 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:54.019708 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:54.177795 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:54.191261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-64e58adb-7708-4a85-8c30-56ee8c71dfa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.197394 Sep 28 07:25:54.192378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 112/237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:53 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:55.219037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:55.219037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:55.223457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:55.224073 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:55.224571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:55.225410 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:55.225929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:55.226416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:55.365388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:55.375494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c9df65b6-6de0-4e71-ad25-c8fec3558454 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.163456 Sep 28 07:25:55.385667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 126/238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:55 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:56.399571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:56.400205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:56.407342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:56.407819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:56.408247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:56.409006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:56.409457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:56.409877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:56.537625 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:56.545660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-51a19436-d6c7-496a-a84b-05a6b8e04462 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.149832 Sep 28 07:25:56.546276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 113/239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:56 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:57.568914 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:57.569552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:57.575796 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:57.576280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:57.576719 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:57.577563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:57.578034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:57.578446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:57.704648 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:57.712395 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13ab78a4-6bf2-482d-990e-44024d343db3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.147509 Sep 28 07:25:57.712989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 127/240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:57 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:58.736363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:58.737040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:58.744267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:58.744690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:58.745339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:58.746425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:58.747185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:58.747731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:58.889719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:25:58.897318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2b7d4cca-9723-465a-b4f2-7811f7bda0aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.165304 Sep 28 07:25:58.897882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 114/241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:58 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:25:59.919640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:25:59.921440 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:25:59.930262 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:59.930754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:59.931444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:25:59.932140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:25:59.933225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:25:59.933225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:00.073296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:00.081911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5da78f0a-f4bd-40ce-b213-dfe213bd4c65 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.166098 Sep 28 07:26:00.082481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 128/242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:25:59 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:01.106849 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:01.108289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:01.117975 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:01.118664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:01.119104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:01.119814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:01.120273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:01.120698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:01.273205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:01.281828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e7875023-73ed-475f-b69c-955998cae941 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.181074 Sep 28 07:26:01.282495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 115/243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:01 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:02.307205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:02.308545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:02.321582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:02.322113 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:02.322806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:02.323519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:02.323975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:02.324404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:02.504747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:02.513747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1123bc93-23b2-4a88-905e-1f22a02dba71 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.212917 Sep 28 07:26:02.516438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 129/244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:02 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:03.539745 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:03.540361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:03.554447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:03.555119 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:03.555661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:03.556837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:03.557321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:03.557768 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:03.562452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=75 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:03.815454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:03.826359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8477692e-6a00-47a9-bce1-7624817b9662 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.290417 Sep 28 07:26:03.827559 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 116/245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:03 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:04.851513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:04.853366 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:04.861150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:04.861972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:04.862570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:04.863489 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:04.864152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:04.865354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:04.870822 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=77 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:05.046259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:05.063356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a95dd15-1ec9-49c7-bc00-cc00cb789bd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.215579 Sep 28 07:26:05.065332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 130/246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:04 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:06.088666 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:06.089456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:06.093343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=26 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:06.103044 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:06.103550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:06.104130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:06.104858 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:06.105461 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:06.105761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:06.339750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:06.354109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6accc4c5-8015-426e-9df3-20ef750b9a64 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1522 microversion: 2.1 time: 0.269514 Sep 28 07:26:06.371961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 117/247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:06 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:07.383228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:07.384826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:07.388291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=26 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:07.393230 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:07.393727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:07.394166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:07.394949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:07.395418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:07.395870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:07.583750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:07.595260 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a5c69a3-8238-456e-8daa-fe783cecdc73 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1502 microversion: 2.1 time: 0.216963 Sep 28 07:26:07.596224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 131/248] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:07 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:07.618944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:07.620603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:07.629587 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:07.630324 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:07.630761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:07.631469 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:07.631925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:07.632350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:07.877138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:07.887814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c406f124-3e0d-4f7d-8e73-279505583adf tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1515 microversion: 2.1 time: 0.272593 Sep 28 07:26:07.906624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 118/249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:07 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:09.384220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:09.391899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:09.410806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:09.411301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:09.411741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:09.412453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:09.412906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:09.413345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:09.495355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'flavor' on Instance uuid d3780a43-5882-4fed-90eb-bd39060f6d99 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:26:09.684817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13d1dd63-dee8-4a65-afcf-79efa6b29266 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/action" status: 200 len: 32 microversion: 2.1 time: 0.304262 Sep 28 07:26:09.688640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 132/250] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:26:09 2022] POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:26:09.711473 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:09.711998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:09.732002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:09.732536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:09.733503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:09.737248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:09.737992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:09.738676 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:10.407104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:10.423640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b6f3424d-4e89-44e9-86eb-ac41ae1e435d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.718136 Sep 28 07:26:10.424351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 119/251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:09 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:11.452033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:11.453393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:11.461208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:11.461935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:11.462668 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:11.463531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:11.464128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:11.464699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:11.777049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:11.785556 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-79356e7c-cda3-49c6-822c-38a0e866b9ca tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.338215 Sep 28 07:26:11.789291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 133/252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:11 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:12.811419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:12.812698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:12.822073 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:12.822886 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:12.823683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:12.825182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:12.825905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:12.827498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:13.047138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:13.063325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-500f243c-a3f9-48d4-b5df-ffcd591caeb1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.253653 Sep 28 07:26:13.063325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 120/253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:12 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:14.084829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:14.104980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:14.154437 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:14.155400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:14.156017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:14.156727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:14.157242 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:14.157833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:14.338358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:14.350041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0fd83951-3fb9-4e1f-97a0-084e45df4c56 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.267898 Sep 28 07:26:14.351249 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 134/254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:14 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:15.374864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:15.376130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:15.390903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:15.391674 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:15.392272 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:15.393171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:15.393759 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:15.394332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:15.690829 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:15.699757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4fa91a90-3c9d-44db-85ea-7f1781dfbc4c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.328981 Sep 28 07:26:15.718270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 121/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:15 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:16.723420 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:16.724046 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:16.735252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:16.735783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:16.736265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:16.737133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:16.737629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:16.738088 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:16.919355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:16.933024 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb1d24f9-098a-4f04-a894-d31960dd3458 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.213289 Sep 28 07:26:16.934270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 135/256] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:16 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:17.957486 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:17.958091 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:17.967719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:17.968463 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:17.969076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:17.969957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:17.970573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:17.973502 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:18.226434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:18.234964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e88237bf-3b24-4f02-bd65-b7ab06216df0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.281224 Sep 28 07:26:18.235539 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 122/257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:17 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:19.259497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:19.260200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:19.267872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:19.268416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:19.268853 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:19.269695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:19.270395 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:19.271048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:19.425302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:19.437385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f4409e00-dc59-4500-83a3-a128a61bb484 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.179154 Sep 28 07:26:19.438635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 136/258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:19 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:20.460182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:20.460991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:20.474030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:20.477637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:20.478531 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:20.479251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:20.479707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:20.480129 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:20.692232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:20.709158 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bb8aad56-f19b-4627-9fcd-871d7d9cfce6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.252961 Sep 28 07:26:20.726676 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 123/259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:20 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:21.429003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:21.429625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:21.438312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:21.439068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:21.439666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:21.440538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:21.441194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:21.441611 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:21.471655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d99f3c4d-c134-452c-80fb-c84cfdc28b4c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/ips" status: 200 len: 145 microversion: 2.1 time: 0.047132 Sep 28 07:26:21.472228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 137/260] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:26:21 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:26:21.738668 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:21.739930 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:21.747380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:21.748626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:21.749350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:21.750051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:21.750503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:21.750913 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:21.891840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:21.900072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-76b590de-da48-4144-afbc-5bfa79f7ea3d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.168459 Sep 28 07:26:21.901776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 124/261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:21 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:22.923521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:22.924213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:22.930694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:22.931509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:22.932005 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:22.932894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:22.933367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:22.933963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:23.104873 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:23.117487 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ca43298-1255-41ad-8ebd-f6a165a678e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.197728 Sep 28 07:26:23.133114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 138/262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:22 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:23.912718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:23.913365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:23.919999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:23.921232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:23.921675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:23.922395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:23.922853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:23.923279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:23.949489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-87f23727-36af-44a5-8bf8-89a14cf8afe6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.040623 Sep 28 07:26:23.950313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 125/263] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Sep 28 07:26:23 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:26:24.143295 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:24.143950 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:24.161971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:24.162465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:24.162899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:24.163597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:24.164046 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:24.164461 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:24.311056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:24.320412 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ada9e647-9b51-4164-873d-e158c4457a3e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.182654 Sep 28 07:26:24.329662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 139/264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:24 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:24.737400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c8d8fa1d-6754-415b-b14e-dbadcddd66c0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Action: 'create', calling method: .version_select at 0x7fa862055b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-591482661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBmt2YWKhPf6U6hAph23ll1V2or5bamPOVFXPz4NPeAd8ZEPyX8HXZGbAZ1ipl+ZGxRBCqPJax8Xs0paPen2drqjcG2ZUzNz5rukOiNxfHqElo4ZYJS5PY7xPNUFs8srA=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:24.753358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c8d8fa1d-6754-415b-b14e-dbadcddd66c0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Getting quotas for project a3324b12312f43ebab7273b438ad9b65. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:26:24.757271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c8d8fa1d-6754-415b-b14e-dbadcddd66c0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Getting quotas for user 06451ea3cd91471c9b09966516090509 and project a3324b12312f43ebab7273b438ad9b65. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:26:24.779011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c8d8fa1d-6754-415b-b14e-dbadcddd66c0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045418 Sep 28 07:26:24.779788 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 126/265] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:26:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:26:24.880960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-343511849", "imageRef": "5af03cb8-752e-4e90-a76f-35f9338684cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-591482661", "networks": [{"uuid": "7b68ac1b-c804-4aee-b2d1-c4dbcb5ee6d5"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:24.933967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] validate_networks() for [('7b68ac1b-c804-4aee-b2d1-c4dbcb5ee6d5', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:26:25.295831 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:26:25.296458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:26:25.296931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:26:25.297380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:26:25.297835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:26:25.306997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:25.307467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:25.307887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:25.308588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:25.309063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:25.309477 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:25.327136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Getting quotas for project a3324b12312f43ebab7273b438ad9b65. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:26:25.331070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Getting quotas for user 06451ea3cd91471c9b09966516090509 and project a3324b12312f43ebab7273b438ad9b65. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:26:25.343444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:26:25.345741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5af03cb8-752e-4e90-a76f-35f9338684cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:26:25.357109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:25.357812 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:25.364714 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:25.365303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:25.365837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:25.366602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:25.367810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:25.368298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:25.409140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d3c8f4e7-ee5d-4a9a-8233-c88e5bd2a7a9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522653 Sep 28 07:26:25.409140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 140/266] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:26:25.411167 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-20a6e790-8881-45ba-9d0c-f7b62b148a06 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:25.411818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-20a6e790-8881-45ba-9d0c-f7b62b148a06 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:25.472511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-20a6e790-8881-45ba-9d0c-f7b62b148a06 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:25.479969 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-20a6e790-8881-45ba-9d0c-f7b62b148a06 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1257 microversion: 2.1 time: 0.072507 Sep 28 07:26:25.480978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 141/267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:25 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:25.521105 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:25.534637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-75027332-b276-4e84-a5ce-f5c3246c289d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.182094 Sep 28 07:26:25.535347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 127/268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:25 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:26.502908 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:26.503517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:26.509434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:26.509922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:26.510351 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:26.511265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:26.511737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:26.512193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:26.557882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:26.558483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:26.566231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:26.566735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:26.567168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:26.567853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:26.568533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:26.569209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:26.581128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:26.593759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-84e10533-3b40-4b66-8f5d-e8451b8ce8c3 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1309 microversion: 2.1 time: 0.095529 Sep 28 07:26:26.594899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 142/269] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:26 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:26.730099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:26.740401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d78d2d06-de32-4d2c-bbd9-b7be1ece9596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.186395 Sep 28 07:26:26.741197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 128/270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:26 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:27.313306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:27.313837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:27.319737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.320214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.320642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.321343 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.321789 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.322206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.344102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lazy-loading 'flavor' on Instance uuid 85725e51-be6a-4dc2-9438-347c786282f0 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:26:27.534329 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4a4c5ac-e4ab-402f-bbd0-a62b7b21cee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/action" status: 202 len: 0 microversion: 2.20 time: 0.225445 Sep 28 07:26:27.534942 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 143/271] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 07:26:27 2022] POST /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:26:27.543013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:27.543648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:27.550182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.550663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.551093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.551779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.552232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.552654 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.618405 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:27.619017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:27.625183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.625671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.626109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.626800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.627251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.627671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.682093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:27.690763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:27.692287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:27.693608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cb12a5f8-3fad-4e02-9a9d-055edc269562 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.154387 Sep 28 07:26:27.704541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 129/272] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:27 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:27.705332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:27.705332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:27.705683 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a7bc0563-e4b1-4068-98ea-73848e8bc26f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1309 microversion: 2.1 time: 0.091622 Sep 28 07:26:27.706255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 144/273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:27 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:27.763414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:27.764067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:27.770304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.770785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.771218 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.771915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:27.772359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:27.772775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:27.903902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:27.912175 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a5034d02-6d0c-46a9-bac8-7e3ab109df2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.152542 Sep 28 07:26:27.912722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 130/274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:27 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:28.721229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:28.722380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:28.727720 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:28.728334 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:28.729162 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:28.729644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:28.730075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:28.730753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:28.731223 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:28.731716 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:28.735268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:28.735746 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:28.736180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:28.737090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:28.737544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:28.737963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:28.802537 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:28.810404 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-997c7694-1c02-4e37-af41-2853ccc56a75 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1309 microversion: 2.1 time: 0.086365 Sep 28 07:26:28.811478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 131/275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:28 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:28.866584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:28.875538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:28.877015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:28.878175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8f7ea7d-27b4-4789-8de5-85c6cc0317b9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.160903 Sep 28 07:26:28.878730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 145/276] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:28 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:28.935077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:28.936382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:28.942254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:28.942735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:28.943159 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:28.943831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:28.944289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:28.944679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:29.207509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:29.215028 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bea2e9a8-b99b-4d4a-ab5b-fa579c4fe6b3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.284045 Sep 28 07:26:29.215576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 132/277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:28 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:29.834730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:29.835336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:29.841192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:29.841731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:29.842302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:29.843002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:29.843447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:29.843889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:29.903321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:29.904017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:29.904186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:29.910485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:29.910965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:29.911392 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:29.912077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:29.912212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a40f2578-05d8-49f7-aa59-f11d3f12b669 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1309 microversion: 2.1 time: 0.081746 Sep 28 07:26:29.912527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:29.912754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 146/278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:29 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:29.912966 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:30.045251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:30.053284 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:30.054752 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:30.055900 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-dc30ce02-f397-4e23-a33a-47babad1f31c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.156538 Sep 28 07:26:30.056703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 133/279] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:29 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:30.244911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:30.245474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:30.251943 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:30.252423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:30.252848 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:30.253553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:30.253995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:30.254409 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:30.381032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:30.389049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-090bbe81-9366-4f26-9bcc-8df2a5d30a74 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.147771 Sep 28 07:26:30.389616 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 147/280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:30 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:30.936573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:30.937982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:30.946207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:30.946695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:30.947125 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:30.947829 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:30.948309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:30.948754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:30.954269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:30.976996 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a44a5034-679d-4fe4-aa38-8010ea5dd975"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:30.980565 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:30.987818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:30.988418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:30.989321 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:30.990458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:30.991058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:30.991626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:31.051507 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:31.060009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0ebc1c79-2c96-467f-b095-2643a1f3ed3b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1315 microversion: 2.1 time: 0.128947 Sep 28 07:26:31.078309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 134/281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:30 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:31.083154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:31.088551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:31.102463 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:31.104529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:31.104995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:31.105862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:31.106761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:31.107385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:31.375130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:31.388019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:31.390121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:31.391326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a731a153-dac7-4fa6-85c7-5a98a7e30ccb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.311981 Sep 28 07:26:31.417089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 135/282] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:31 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:31.427108 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:31.427909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:31.440648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:31.447705 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3d590965-6a26-469d-abec-614fe854f643 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486064 Sep 28 07:26:31.448293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:31.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:31.450313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 148/283] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:26:30 2022] POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:26:31.451956 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:31.452591 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:31.453339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:31.872096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:31.882193 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9acaa608-e55c-4552-996d-caceadb3b51d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.458916 Sep 28 07:26:31.883522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 136/284] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:31 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:32.084423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:32.085839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:32.093564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:32.094344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:32.094779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:32.095485 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:32.095936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:32.096354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:32.227769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:32.235615 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4d0a45c4-891b-4779-be87-7f071dd7758a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.155843 Sep 28 07:26:32.236179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 149/285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:32 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:32.423019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:32.424249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:32.430749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:32.431689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:32.432270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:32.433170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:32.433778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:32.434194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:32.582269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:32.590470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:32.592776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:32.593976 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-00b22740-90a2-493a-9b64-0141b0684fb0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.175442 Sep 28 07:26:32.594522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 137/286] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:32 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:32.909347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:32.909962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:32.916491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:32.917001 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:32.917442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:32.918338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:32.918960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:32.919547 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:33.058070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:33.066829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d754b888-32e5-4cfe-8fb4-1259b2e9a1b6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.163183 Sep 28 07:26:33.067401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 150/287] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:32 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:33.258505 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:33.259026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:33.265274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:33.265762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:33.266195 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:33.266882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:33.267333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:33.267752 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:33.406311 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:33.414338 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4d017183-3b67-4642-9a92-5105d542e9a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.159890 Sep 28 07:26:33.414908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 138/288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:33 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:33.618903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:33.619590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:33.628864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:33.629912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:33.630710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:33.631492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:33.632175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:33.632663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:33.782599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:33.790890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:33.792462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:33.793660 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88c4b06d-83c4-4dd9-9d78-4b6a2b0bcafe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.178611 Sep 28 07:26:33.794401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 151/289] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:33 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:34.091210 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:34.092602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:34.099228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:34.099718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:34.100149 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:34.100851 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:34.101331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:34.101754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:34.260133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:34.269114 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-de111c27-1d56-49f8-9fc8-8972814a4461 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.181655 Sep 28 07:26:34.269696 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 139/290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:34 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:34.438340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:34.438949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:34.444908 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:34.445414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:34.445845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:34.446534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:34.446983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:34.447401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:34.582373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:34.590347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-418c67f2-8178-4681-ae65-645747da5fa9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.155871 Sep 28 07:26:34.590995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 152/291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:34 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:34.819438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:34.820043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:34.821895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:34.827658 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:34.828139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:34.828653 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:34.829413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:34.829961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:34.830331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:34.956493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:34.964579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:34.965972 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:34.968171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-afd8fd3e-9704-4a0b-9e1f-88eafa6560b3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.152555 Sep 28 07:26:34.968735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 140/292] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:34 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:35.292840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:35.293512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:35.299857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:35.300332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:35.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:35.301529 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:35.301980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:35.302398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:35.319800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:35.478327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:35.605139 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:35.614050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:35.614709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1a38dee-643b-4805-bb39-32222411de92 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.325137 Sep 28 07:26:35.614809 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 153/293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:35 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:35.616069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:35.630471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:35.631250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:35.631928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:35.632866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:35.633603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:35.634209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:35.847919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:35.856400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a607dfd1-a1bc-4a49-95aa-58d03194f84d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.246477 Sep 28 07:26:35.874311 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 141/294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:35 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:35.994011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:35.994662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:36.004919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:36.004919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:36.004919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:36.004919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:36.005978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:36.005978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:36.212475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:36.231001 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:36.237160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:36.237650 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-394697a6-9c2a-457e-a98d-ebedd5f53abd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.247888 Sep 28 07:26:36.249728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 154/295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:35 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:36.645444 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:36.646146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:36.648390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:36.657468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:36.657965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:36.658425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:36.659120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:36.659583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:36.660011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:36.834456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:36.843593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-509992df-402a-412d-a588-a5ee8375faa0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.202221 Sep 28 07:26:36.844644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 142/296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:36 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:36.879651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:36.880343 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:36.887430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:36.889154 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:36.890179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:36.891133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:36.891947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:36.892363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:37.100033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:37.111350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e2ef4f1f-fc71-45fa-9263-18224da4728f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.236008 Sep 28 07:26:37.112122 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 155/297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:36 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:37.267300 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:37.267911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:37.274768 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:37.275251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:37.275679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:37.276367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:37.276817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:37.277263 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:37.449779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:37.460181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:37.462329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:37.464358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6afcf8b8-2a7a-4edb-ba07-7c81e5714afe tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.201825 Sep 28 07:26:37.477544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 143/298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:37 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:37.868172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:37.868699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:37.875089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:37.876709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:37.877675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:37.878284 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:37.879149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:37.879847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:37.881031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:38.059821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:38.073680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3e1f7cdb-514c-48e7-8168-33dd16896151 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.206304 Sep 28 07:26:38.075021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 156/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:37 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:38.134261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:38.134836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:38.142177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:38.142723 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:38.143076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:38.143818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:38.144330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:38.144750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:38.339745 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:38.348415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ae4c044a-1b46-4265-97c1-369684bd6fc8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.218248 Sep 28 07:26:38.351419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 144/300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:38 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:38.492575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:38.493311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:38.506762 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:38.507506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:38.508394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:38.509585 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:38.510194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:38.510888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:38.744424 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:38.753893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:38.755690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:38.756845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1d4876f-ddae-4e2f-b2d5-09ad0a73845f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.268806 Sep 28 07:26:38.757920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 157/301] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:38 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:39.097851 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:39.098854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:39.108221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:39.108783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:39.109243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:39.109942 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:39.110552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:39.111124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:39.292971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:39.301455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d8f53bc0-0116-434d-836a-744bc1b58a43 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.207680 Sep 28 07:26:39.302035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 145/302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:39 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:39.371722 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:39.372417 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:39.379718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:39.380206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:39.380880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:39.381608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:39.382059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:39.382481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:39.522837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:39.531858 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a2658d75-4256-409a-89e0-f41345373ff8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.164060 Sep 28 07:26:39.532433 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 158/303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:39 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:39.783931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:39.784551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:39.794951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:39.795484 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:39.795978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:39.796693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:39.797173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:39.797805 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:39.958407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:39.968245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:39.969735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:39.970920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f27725fa-69a7-4cd3-b216-6e1161228a35 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.191140 Sep 28 07:26:39.971466 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 146/304] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:39 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:40.323972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:40.324718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:40.330835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:40.331327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:40.331740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:40.332428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:40.332876 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:40.333328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:40.475083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:40.484370 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-acc26d48-5223-4ba5-bc75-9d89ad5cc5a6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.164127 Sep 28 07:26:40.485261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 159/305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:40 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:40.555947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:40.557332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:40.565695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:40.566458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:40.567076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:40.568155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:40.568958 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:40.569622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:40.717089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:40.727096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-57225cfa-650d-479b-94df-6e71f12a55c1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.174842 Sep 28 07:26:40.727096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 147/306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:40 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:40.998223 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:40.998907 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:41.005950 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:41.006661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:41.007099 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:41.007826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:41.008447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:41.009055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:41.013765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:41.167928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:41.178054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:41.179297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:41.180695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96bdc35b-9a4d-4e1a-b4b6-6983557189e7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.186532 Sep 28 07:26:41.181933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 160/307] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:40 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:41.508182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:41.508713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:41.515793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:41.516293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:41.516737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:41.517594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:41.518050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:41.518481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:41.720339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:41.729634 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ada70583-4e37-4851-8747-6ef0a11dbf0d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.225351 Sep 28 07:26:41.733046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 148/308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:41 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:41.750087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:41.751498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:41.759422 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:41.760287 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:41.760923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:41.761996 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:41.762734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:41.763923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:41.927702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:41.937223 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca6e42ea-16c5-4e5b-bb38-a755519103e2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.191225 Sep 28 07:26:41.949492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 161/309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:41 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:42.207825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:42.208431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:42.214321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:42.214792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:42.215216 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:42.215891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:42.216422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:42.216843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:42.355801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:42.364413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:42.365893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:42.367143 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-80d65364-2517-41d1-8638-ceb9d4db9d59 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.163743 Sep 28 07:26:42.367678 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 149/310] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:42 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:42.753319 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:42.753913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:42.760165 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:42.760638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:42.761109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:42.761769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:42.762212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:42.762625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:42.895768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:42.903917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-86795ac5-6642-411a-9ec7-4e3dd2e2b909 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.154326 Sep 28 07:26:42.905118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 162/311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:42 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:42.963473 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:42.964170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:42.971221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:42.971698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:42.972129 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:42.972821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:42.973299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:42.973720 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:43.186575 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:43.188745 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:43.195693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-205e603a-db3c-4392-873c-5e7764b15d7e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.235931 Sep 28 07:26:43.196188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 150/312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:42 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:43.394028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:43.394850 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:43.401252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:43.401697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:43.402284 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:43.402949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:43.403510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:43.403970 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:43.540117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:43.548963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:43.550161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:43.551314 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5ac4380-52c5-494a-b251-cde6be90268a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.161622 Sep 28 07:26:43.551875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 163/313] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:43 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:43.749912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-8494a519-b0e7-46c4-8c36-8312dd4e8450 req-80c6e239-a94e-4e47-a3e1-488fa75991e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:43.759428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8494a519-b0e7-46c4-8c36-8312dd4e8450 req-80c6e239-a94e-4e47-a3e1-488fa75991e6 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:43.759896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8494a519-b0e7-46c4-8c36-8312dd4e8450 req-80c6e239-a94e-4e47-a3e1-488fa75991e6 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:43.760315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8494a519-b0e7-46c4-8c36-8312dd4e8450 req-80c6e239-a94e-4e47-a3e1-488fa75991e6 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:43.771194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-8494a519-b0e7-46c4-8c36-8312dd4e8450 req-80c6e239-a94e-4e47-a3e1-488fa75991e6 service nova] Creating event network-changed:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:26:43.776190 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-8494a519-b0e7-46c4-8c36-8312dd4e8450 req-80c6e239-a94e-4e47-a3e1-488fa75991e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030695 Sep 28 07:26:43.776770 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 151/314] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:26:43.932429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:43.933102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:43.940140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:43.940613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:43.941187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:43.941929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:43.942397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:43.942809 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:44.076814 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:44.084358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0796c395-6fe2-4329-a89a-9043b3bc7596 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.155993 Sep 28 07:26:44.084923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 164/315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:43 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:44.221273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:44.221881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:44.227929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:44.228436 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:44.228863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:44.229572 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:44.230019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:44.230439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:44.360748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:44.368297 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6cf7585a-ab54-4ce5-9efd-79a637e3c3f8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.152392 Sep 28 07:26:44.368847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 152/316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:44 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:44.577663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:44.578379 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:44.584864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:44.585477 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:44.585982 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:44.586886 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:44.587491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:44.587918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:44.724674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:44.733802 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:44.735271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:44.736506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e32ba79f-8904-4f48-89f3-21a6b3fb728c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.163526 Sep 28 07:26:44.737163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 165/317] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:44 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:45.108609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:45.109384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:45.115499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:45.116061 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:45.116565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:45.117359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:45.117883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:45.118376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:45.309243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:45.317766 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9935489b-c067-44bf-afb3-d7403e5d7aa3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.214031 Sep 28 07:26:45.318328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 153/318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:45 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:45.392405 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:45.393186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:45.399768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:45.400344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:45.400856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:45.401632 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:45.402163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:45.402589 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:45.539959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:45.548772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ca95ce9-fc07-4b29-a53a-7405838d1f53 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.160956 Sep 28 07:26:45.549381 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 166/319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:45 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:45.762603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:45.763896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:45.769931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:45.770419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:45.770864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:45.771551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:45.772002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:45.772420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:45.899315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:45.908010 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:45.909477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:45.910621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-df9ecf38-61ce-4825-871a-c1e68ed79c04 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.151996 Sep 28 07:26:45.911167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 154/320] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:45 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:46.342729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:46.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:46.349147 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:46.349631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:46.350066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:46.350747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:46.351192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:46.351608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:46.476742 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:46.485052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2c67b5a6-3309-487b-8479-42beaff095c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.146886 Sep 28 07:26:46.485619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 167/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:46 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:46.572586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:46.573990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:46.580573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:46.581087 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:46.581521 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:46.582222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:46.582673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:46.583092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:46.713489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:46.720937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7c748ef5-5c0b-473c-9b3f-52e528cdf0fc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.152830 Sep 28 07:26:46.721516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 155/322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:46 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:46.937625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:46.938126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:46.943990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:46.944457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:46.944882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:46.945569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:46.946014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:46.946427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:47.079676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:47.087850 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:47.089300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:47.090447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cffb55d4-9062-44bb-b12c-294bcea647c8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.157794 Sep 28 07:26:47.090998 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 168/323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:46 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:47.507340 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:47.507974 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:47.514355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:47.514822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:47.515248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:47.515921 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:47.516368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:47.516785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:47.645160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:47.652632 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-687b7853-e222-4b0f-b86d-e128ec5ce21a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.149180 Sep 28 07:26:47.653230 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 156/324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:47 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:47.744759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:47.745386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:47.752327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:47.752801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:47.753267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:47.753951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:47.754397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:47.754817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:47.898035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:47.906481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-81a87aa7-6b95-465d-af2a-baf61c7e0aab tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.165471 Sep 28 07:26:47.907063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 169/325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:47 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:48.115706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:48.116316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:48.122294 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.122781 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.123299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.123996 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.124456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.124905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.259367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:48.268205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:48.269693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:48.270837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-96669f02-5fe9-4bf7-af51-2340dc6f2912 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.159057 Sep 28 07:26:48.271391 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 157/326] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:48 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:48.677598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:48.678329 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:48.684700 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.685218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.685650 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.686333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.687320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.687743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.817890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:48.826271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-adcb7596-a902-47be-91ce-0db2a2e19fcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1501 microversion: 2.1 time: 0.153547 Sep 28 07:26:48.827022 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 170/327] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:48 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:48.850276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4d73ba4-bb6c-4f57-8b61-96bff2363c13"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:48.852663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:48.859757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.860325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.860761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.861483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.861960 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.862376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.885633 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] HTTP exception thrown: Cannot 'attach_volume' instance d3780a43-5882-4fed-90eb-bd39060f6d99 while it is in vm_state rescued Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Request method failure captured: Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/os-volume_attachments HTTP/1.1 Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 74 Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aedx0GaOLcT8p38w3Cu7oXV8RXsgepU8W30147Vp_LPN9AKSfFIcayr_DcvqSz5UZviIa-kgfyPfCBolaMQZR11x4crY6KUXnKu86HSGx-ulIR389kAdPlOGWLdzRYr3RjfPpSdk4XmdubfYOM0MFPz7yV3FFLIOIMpclNMGA0Mhg Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:26:48.887331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc7675d275394d8893d0facf20d3a4e7", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: d286b1e0afe9413291e0e2503b4c204a Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {"volumeAttachment": {"volumeId": "c4d73ba4-bb6c-4f57-8b61-96bff2363c13"}} Sep 28 07:26:48.888834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Cannot 'attach_volume' instance d3780a43-5882-4fed-90eb-bd39060f6d99 while it is in vm_state rescued Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'server_id': 'd3780a43-5882-4fed-90eb-bd39060f6d99', 'body': {'volumeAttachment': {'volumeId': 'c4d73ba4-bb6c-4f57-8b61-96bff2363c13'}}} Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:26:48.889713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d3780a43-5882-4fed-90eb-bd39060f6d99 while it is in vm_state rescued Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:26:48.891273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d3780a43-5882-4fed-90eb-bd39060f6d99 while it is in vm_state rescued Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Returning 409 to user: Cannot 'attach_volume' instance d3780a43-5882-4fed-90eb-bd39060f6d99 while it is in vm_state rescued {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-95121e7d-6392-4218-bd3e-a35c9bd00637 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042456 Sep 28 07:26:48.892569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 158/328] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:26:48 2022] POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 07:26:48.898402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:48.898925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:48.904753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.905267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.905696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.906399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.906844 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.907252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.930128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:48.930715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:48.936758 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.937270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.938301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.939090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.939544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.939965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.974498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-647f5683-dcc3-42de-be2c-62d88ac3744f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/action" status: 202 len: 0 microversion: 2.1 time: 0.079959 Sep 28 07:26:48.978588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 171/329] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:26:48 2022] POST /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:26:48.985546 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:48.986237 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:48.993097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.993601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.994031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:48.995464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:48.996176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:48.996939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:49.074236 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:49.082046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4559f981-58e9-4b1a-a517-9558688ab603 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.155715 Sep 28 07:26:49.082613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 159/330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:48 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:49.141323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:49.151233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9d2135d-a8ef-4ec8-a38e-28dfba33bfcb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1509 microversion: 2.1 time: 0.170054 Sep 28 07:26:49.151899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 172/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:48 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:49.296213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:49.297471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:49.303385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:49.304039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:49.304467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:49.305205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:49.305652 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:49.306093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:49.511990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:49.521161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:49.522737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:49.524008 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-75c8e106-7857-45e9-a888-97e0f5e2e2be tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1744 microversion: 2.20 time: 0.231657 Sep 28 07:26:49.524682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 160/332] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:49 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1744 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:50.105248 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:50.105854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:50.112690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:50.113202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:50.113663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:50.114350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:50.114797 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:50.115212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:50.173780 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:50.174624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:50.181101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:50.181850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:50.182284 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:50.183169 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:50.183805 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:50.184393 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:50.247662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:50.256700 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-14f036b5-1438-40a3-9eda-8fc7b0da1bfb tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.155288 Sep 28 07:26:50.257416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 173/333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:50 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:50.334943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:50.343995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b3d08434-0b3b-467f-a641-7c961a3467a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1509 microversion: 2.1 time: 0.173986 Sep 28 07:26:50.344990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 161/334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:50 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:50.550793 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:50.551417 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:50.557934 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:50.558415 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:50.558843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:50.559520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:50.559969 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:50.560385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:50.686664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:50.695590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:50.697037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:50.698200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bb32e0d-55cb-4498-bef6-41af1fa6f623 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1744 microversion: 2.20 time: 0.151834 Sep 28 07:26:50.698947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 174/335] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:50 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:51.283344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:51.283947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:51.290415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.290898 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.291317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.292002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.292447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.292869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.367048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:51.367458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:51.375182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.376012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.376454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.385862 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.386590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.386912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.431136 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:51.439474 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5e4ad576-75d5-42eb-bc3c-18be93f25ed7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.161532 Sep 28 07:26:51.440231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 162/336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:51 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:51.523823 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:51.526163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:51.533316 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7e8342b0-6f0b-4c86-b873-48aa22e2db99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1509 microversion: 2.1 time: 0.170312 Sep 28 07:26:51.533883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 175/337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:51 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:51.724128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:51.724917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:51.730929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.731411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.731834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.732525 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.732985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.733403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.738727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-512391b4-55ac-496c-bda4-ae65ae523f58 req-967e2408-a324-4f4d-b169-479fb32876d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "name": "network-vif-plugged", "status": "completed", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:51.748493 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-512391b4-55ac-496c-bda4-ae65ae523f58 req-967e2408-a324-4f4d-b169-479fb32876d8 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:51.749055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-512391b4-55ac-496c-bda4-ae65ae523f58 req-967e2408-a324-4f4d-b169-479fb32876d8 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:51.749555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-512391b4-55ac-496c-bda4-ae65ae523f58 req-967e2408-a324-4f4d-b169-479fb32876d8 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:51.764780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-512391b4-55ac-496c-bda4-ae65ae523f58 req-967e2408-a324-4f4d-b169-479fb32876d8 service nova] Creating event network-vif-plugged:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:26:51.771717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-512391b4-55ac-496c-bda4-ae65ae523f58 req-967e2408-a324-4f4d-b169-479fb32876d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039679 Sep 28 07:26:51.772519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 176/338] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:26:51.870764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:51.879473 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:51.880907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:51.882071 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e60bf36c-d95a-477e-a700-2b08e54e3b53 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1744 microversion: 2.20 time: 0.162749 Sep 28 07:26:51.882609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 163/339] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:51 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:52.463953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:52.464644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:52.471301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:52.471777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:52.472205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:52.472891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:52.473364 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:52.473783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:52.556801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:52.557432 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:52.563245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:52.563722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:52.564226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:52.564998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:52.565445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:52.565861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:52.602436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:52.614403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3c1c3392-4d5e-41ca-bf36-5f4aaf3e85e9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.154879 Sep 28 07:26:52.615143 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 177/340] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:52 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:52.697683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:52.706304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ee71366a-0a1f-4625-bc97-0240555298f4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1509 microversion: 2.1 time: 0.153952 Sep 28 07:26:52.706860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 164/341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:52 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:52.907502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:52.909094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:52.915649 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:52.916152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:52.916583 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:52.917322 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:52.917774 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:52.918196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:53.223183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:53.231442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:53.232861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:53.234021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-de973e30-e376-41ca-b3eb-e0840eebc6e9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1744 microversion: 2.20 time: 0.330436 Sep 28 07:26:53.234575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 178/342] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:52 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1744 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:53.637505 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:53.638323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:53.645595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:53.646083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:53.646516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:53.647210 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:53.647657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:53.648077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:53.731673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:53.732216 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:53.744339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:53.744983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:53.745434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:53.746504 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:53.746936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:53.747490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:53.799065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:53.807873 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-be48fdee-b59a-4f79-b265-742a64f9e46f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.174253 Sep 28 07:26:53.809258 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 165/343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:53 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:53.883765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:53.891427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33bd9d62-bd17-4363-b66b-81311de03f69 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1515 microversion: 2.1 time: 0.164740 Sep 28 07:26:53.892042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 179/344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:53 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:54.152698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-305c87fc-c5b0-4646-8359-6d02609cd5ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:54.159318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-305c87fc-c5b0-4646-8359-6d02609cd5ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.159859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-305c87fc-c5b0-4646-8359-6d02609cd5ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.160291 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-305c87fc-c5b0-4646-8359-6d02609cd5ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.222088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-305c87fc-c5b0-4646-8359-6d02609cd5ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Going to try to stop instance {{(pid=120451) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 07:26:54.259774 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:54.260364 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:54.268074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.268611 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.269105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.269977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.270492 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-305c87fc-c5b0-4646-8359-6d02609cd5ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action" status: 202 len: 0 microversion: 2.1 time: 0.121494 Sep 28 07:26:54.270622 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.271000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.271531 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 166/345] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:26:54 2022] POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:26:54.280172 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:54.280871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:54.287207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.287698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.288150 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.288828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.289314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.289735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.305362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:26:54.412307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:54.420302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:54.421852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:54.423018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-790b1b1e-74f1-4499-8dd0-f497f862dbaf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1744 microversion: 2.20 time: 0.167161 Sep 28 07:26:54.428995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 180/346] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:54 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:26:54.429152 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:54.435274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-68351566-13d1-4ee1-adeb-aeedce8f0b1c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.159469 Sep 28 07:26:54.435980 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 167/347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:54 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:54.831155 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:54.831676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:54.838037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.838511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.838933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.839603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:54.840047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:54.840454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:54.965827 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:54.975120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b3a989db-95a3-44d8-9646-93e29e94c0b9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.148365 Sep 28 07:26:54.975699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 181/348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:54 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:55.272315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a3ef6e3f-5c2f-4572-afb6-c6dd6b754876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'create', calling method: .version_select at 0x7fa8623710d0>, body: {"keypair": {"name": "tempest-keypair-1265036667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxNy4dPUIaBQMLsOEO/cDE4Eykst5wieQp/aiYVqJ5d5pXjQXZH7jnQj4xP4PuZpMNfP3aWBijG6wFi+AZTStLtX47glNIsq91g+p4OnCbd+Y100fLYig0Sk+D1K+Vj+Q=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:55.287971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-a3ef6e3f-5c2f-4572-afb6-c6dd6b754876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for project fc7675d275394d8893d0facf20d3a4e7. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:26:55.291740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-a3ef6e3f-5c2f-4572-afb6-c6dd6b754876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for user d286b1e0afe9413291e0e2503b4c204a and project fc7675d275394d8893d0facf20d3a4e7. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:26:55.313232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a3ef6e3f-5c2f-4572-afb6-c6dd6b754876 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044618 Sep 28 07:26:55.314319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 168/349] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:26:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:26:55.451104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:55.452128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:55.460368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:55.460843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:55.461086 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:55.461363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:55.462065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:55.462764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:55.463568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:55.463921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:55.467772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:55.468290 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:55.468971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:55.470085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:55.470712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:55.471649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:55.612617 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:55.628203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:55.630000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:55.631404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f2c30b7-b384-4dea-a7d1-9cdc5e6a3354 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.184348 Sep 28 07:26:55.633749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 182/350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:55 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:55.695849 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:55.708344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9c2e6c3d-37ba-4aa8-a1da-69b614283155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.252008 Sep 28 07:26:55.709150 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 169/351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:55 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:55.745131 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a51a62d0-0396-4e76-ac6f-6f03387ef2bf req-6e688a80-b09b-4cd8-b2af-ec4bc757ba7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "name": "network-vif-plugged", "status": "completed", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:55.757040 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a51a62d0-0396-4e76-ac6f-6f03387ef2bf req-6e688a80-b09b-4cd8-b2af-ec4bc757ba7b service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:55.757535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a51a62d0-0396-4e76-ac6f-6f03387ef2bf req-6e688a80-b09b-4cd8-b2af-ec4bc757ba7b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:55.757960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a51a62d0-0396-4e76-ac6f-6f03387ef2bf req-6e688a80-b09b-4cd8-b2af-ec4bc757ba7b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:55.777977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a51a62d0-0396-4e76-ac6f-6f03387ef2bf req-6e688a80-b09b-4cd8-b2af-ec4bc757ba7b service nova] Creating event network-vif-plugged:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:26:55.784018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a51a62d0-0396-4e76-ac6f-6f03387ef2bf req-6e688a80-b09b-4cd8-b2af-ec4bc757ba7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042222 Sep 28 07:26:55.784811 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 183/352] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:26:55.998048 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:55.998803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:56.004847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:56.005451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:56.005980 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:56.006683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:56.007132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:56.007552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:56.213151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:56.226968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-553e14e5-5a66-4410-bd72-67ce37daf0c4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1357 microversion: 2.1 time: 0.232272 Sep 28 07:26:56.240964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 170/353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:55 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:56.659952 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:56.661337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:56.668812 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:56.669656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:56.670270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:56.671195 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:56.671791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:56.672362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:56.734345 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:56.735045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:56.747400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:56.747847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:56.748645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:56.749395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:56.749852 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:56.750280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:56.914358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:56.924524 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:56.926269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:56.927709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-50116243-f8fc-497b-b1b9-fa2218f9d901 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.272807 Sep 28 07:26:56.928784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 184/354] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:56 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:56.934201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1594918150", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2074fef2-a4a7-4181-98e7-e7c64838b0de"}], "security_groups": [{"name": "tempest-securitygroup--1161572388"}], "key_name": "tempest-keypair-1265036667", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:26:57.009275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:57.023862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2b9485b9-57a0-45f3-b866-5125ad7e823e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.295074 Sep 28 07:26:57.045646 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 171/355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:56 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:57.105078 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] validate_networks() for [('2074fef2-a4a7-4181-98e7-e7c64838b0de', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:26:57.252402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:57.253041 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:57.259279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.260113 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.260761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.263951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.263951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.265015 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.438507 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:57.451007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-79efe94b-c17e-404e-8ba9-3e17af244e0f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1548 microversion: 2.1 time: 0.202219 Sep 28 07:26:57.452169 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 172/356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:57 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:57.479535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:57.480535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:57.491285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.491814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.492238 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.493042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.493487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.493914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.603069 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:26:57.603989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:26:57.604574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:26:57.605113 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:26:57.605593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:26:57.618987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.619593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.620116 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.620930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.621478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.621976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.640133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for project fc7675d275394d8893d0facf20d3a4e7. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:26:57.644675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Getting quotas for user d286b1e0afe9413291e0e2503b4c204a and project fc7675d275394d8893d0facf20d3a4e7. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:26:57.658273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:57.666539 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a1500b46-110c-4472-ac12-d150a7ee1f4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1548 microversion: 2.1 time: 0.190872 Sep 28 07:26:57.667320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 173/357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:57 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:57.668447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:26:57.675197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:26:57.700671 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:57.703477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:57.703477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Searching by: {'deleted': False, 'project_id': 'a3324b12312f43ebab7273b438ad9b65'} {{(pid=120451) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 28 07:26:57.710957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.711440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.711869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.712595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.713077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.713664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.750578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-711eea77-d581-451b-aef8-7bc779643a81 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.820086 Sep 28 07:26:57.751391 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 185/358] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:26:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:26:57.763882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-89ca82fe-4dad-479d-b392-d0ce34c64cdb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:57.764807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-89ca82fe-4dad-479d-b392-d0ce34c64cdb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:57.843217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-89ca82fe-4dad-479d-b392-d0ce34c64cdb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:57.851504 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-89ca82fe-4dad-479d-b392-d0ce34c64cdb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1246 microversion: 2.1 time: 0.092155 Sep 28 07:26:57.851838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.multi_cell_list [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120451) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 28 07:26:57.852283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 186/359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:57 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:26:57.959130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:57.959740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:57.978915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-daebbaba-1625-418d-a534-f173b0730abc tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.288083 Sep 28 07:26:57.979631 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 174/360] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Sep 28 07:26:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:26:57.981545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.982519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.983596 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:57.986226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:57.987075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:57.987633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.000985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:58.001574 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:58.016409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:58.020278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:58.020278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.020278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:58.020278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:58.020610 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.344357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:58.365953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:58.367592 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:58.369079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f40cb066-0d46-45ec-94a5-2778eb861adc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.414323 Sep 28 07:26:58.371581 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 187/361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:57 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:58.381310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:58.387093 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:58.409033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:58.415937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:58.416432 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:58.416870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.417500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-980d15c3-479b-4413-bcc7-f108db79b800 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1548 microversion: 2.1 time: 0.420252 Sep 28 07:26:58.417624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:58.418578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:58.418703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 175/362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:57 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1548 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:58.418792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.600057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:58.611829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ca11e0c-3893-482d-a398-4f597043c2a9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.239550 Sep 28 07:26:58.612644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 188/363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:58 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:58.883271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:58.884026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:58.891247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:58.892059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:58.893030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.893986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:58.894551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:58.894982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:58.963004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:58.973193 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1139f148-b948-4b5d-89b3-f19e79e4ada4 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1298 microversion: 2.1 time: 0.094492 Sep 28 07:26:58.973761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 176/364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:58 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:26:59.399323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:59.400681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:59.411048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:59.411532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:59.411961 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:59.412693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:59.413166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:59.413817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:59.582287 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:59.591692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:59.593344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:59.594761 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f5ab9a8-9cec-4ccb-a449-f4d4de014c12 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.199609 Sep 28 07:26:59.596334 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 189/365] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:26:59 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:26:59.640821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:26:59.642575 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:26:59.649501 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:59.650318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:59.650911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:59.651843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:26:59.652497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:26:59.653093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:26:59.841056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:26:59.885141 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a336f702-de80-4925-8ce5-603ef2cfb155 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.246244 Sep 28 07:26:59.906859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 177/366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:59 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:00.004272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:00.015087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:00.034416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.051212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.051212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.051212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.051212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.051748 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.223732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:00.240010 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cb52db57-a6c1-4ed5-84cf-cef0901749c7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1306 microversion: 2.1 time: 0.240927 Sep 28 07:27:00.249025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 190/367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:26:59 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1306 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:00.305592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01f62a26-d015-420d-bd06-4b8dd976b71c"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:00.308737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:00.316938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.317353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.317791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.318494 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.318959 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.319368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.625731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:00.627637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:00.639961 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.640873 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.641909 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.643385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.644215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.649652 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.810764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ca56463a-1896-4c84-badb-c7c21e1be286 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509921 Sep 28 07:27:00.820784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 178/368] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:27:00 2022] POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:27:00.894156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:00.914289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:00.914996 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:00.919995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:00.924055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:00.926491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.926989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.927427 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:00.928188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:00.929629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a918543-9fd3-41e6-9c30-187ede079d44 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.309192 Sep 28 07:27:00.957195 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 191/369] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:00 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:27:00.957393 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:00.957393 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:01.162276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:01.174437 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4f83d2e8-c6af-4100-b7e4-b448f418310f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.265485 Sep 28 07:27:01.194879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 179/370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:00 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:01.271558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:01.272279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:01.280323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:01.280757 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:01.281221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:01.281956 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:01.282442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:01.282876 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:01.452534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:01.462190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d218e34-9fbc-4f1b-9736-2707baf2a7c3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.195362 Sep 28 07:27:01.463101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 192/371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:01 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:01.966828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:01.967738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:01.975508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:01.976461 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:01.977335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:01.978271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:01.978935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:01.979548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:02.156235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:02.166873 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:02.168673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:02.169908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-803e0019-2dee-4586-aae8-7237c8cd2838 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.207898 Sep 28 07:27:02.170618 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 180/372] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:01 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:02.201206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:02.202345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:02.208670 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:02.209203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:02.209637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:02.210332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:02.210957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:02.211584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:02.379124 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:02.390470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-73b5bc0f-382d-4f82-801c-d92945839df0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.194076 Sep 28 07:27:02.392403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 193/373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:02 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:02.489573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:02.490323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:02.496818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:02.497445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:02.497876 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:02.498568 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:02.499178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:02.499596 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:02.658097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:02.670703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-46bde415-98f8-4dd9-8f4b-9bede5c62ecc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.185506 Sep 28 07:27:02.671288 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 181/374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:02 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:03.197819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:03.198462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:03.205846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:03.206518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:03.206753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:03.207460 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:03.207912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:03.208338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:03.355387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:03.364828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:03.366384 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:03.367602 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c0cb81b-730d-40dc-8849-5bba569c243a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.173687 Sep 28 07:27:03.368383 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 194/375] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:03 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:03.419163 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:03.419932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:03.427202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:03.427686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:03.428115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:03.428833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:03.429307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:03.430228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:03.585897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:03.600222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ad8dcf65-8ecb-4042-8f7e-79bab5ab8cc2 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.185060 Sep 28 07:27:03.601094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 182/376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:03 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:03.699506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:03.700877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:03.710491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:03.711304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:03.711743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:03.712450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:03.712905 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:03.713436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:03.731448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:03.862345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:03.870000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1b86123-53b7-4507-8b7c-bdcd52ab4791 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.174392 Sep 28 07:27:03.874854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 195/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:03 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:04.393984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:04.394968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:04.401329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:04.401815 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:04.402245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:04.402933 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:04.403380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:04.403793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:04.420328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:04.550578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:04.560142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:04.561929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:04.564264 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-84ac3798-927b-4061-949a-d57361e97862 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.173879 Sep 28 07:27:04.579857 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 183/378] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:04 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:04.623594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:04.624196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:04.631693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:04.633471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:04.634283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:04.635543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:04.635998 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:04.636414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:04.804481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:04.826728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0224588e-84ae-4e92-84f6-fa775da81454 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.205926 Sep 28 07:27:04.827951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 196/379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:04 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:04.894086 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:04.895148 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:04.909122 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:04.910191 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:04.910672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:04.911949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:04.912409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:04.912831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:05.297912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:05.410527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:05.420399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6909c623-661d-444d-9476-12baeaaa0dd7 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.529244 Sep 28 07:27:05.433415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 184/380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:04 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:05.594375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:05.595935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:05.605602 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:05.607826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:05.608510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:05.609188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:05.610157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:05.611109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:05.611728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:05.796032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:05.810054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:05.811715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:05.813630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4af26c03-2ac5-463c-b1bb-fec91e2c34d2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.223459 Sep 28 07:27:05.814512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 197/381] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:05 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:05.855642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:05.856538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:05.864755 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:05.865502 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:05.866101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:05.867181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:05.869684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:05.870324 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:06.053261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e25f4e0e-6fab-4058-b742-ba1ceab40d73 req-6037d8ea-c5d2-4c40-ab0b-5ddbe5184614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268a5985-193b-4474-81f1-3140ec176c98", "tag": "8f48e4d9-3822-4acd-8b65-44198c2add90"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:06.074043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e25f4e0e-6fab-4058-b742-ba1ceab40d73 req-6037d8ea-c5d2-4c40-ab0b-5ddbe5184614 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:06.074865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e25f4e0e-6fab-4058-b742-ba1ceab40d73 req-6037d8ea-c5d2-4c40-ab0b-5ddbe5184614 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:06.075572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e25f4e0e-6fab-4058-b742-ba1ceab40d73 req-6037d8ea-c5d2-4c40-ab0b-5ddbe5184614 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:06.089413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e25f4e0e-6fab-4058-b742-ba1ceab40d73 req-6037d8ea-c5d2-4c40-ab0b-5ddbe5184614 service nova] Creating event network-changed:8f48e4d9-3822-4acd-8b65-44198c2add90 for instance 268a5985-193b-4474-81f1-3140ec176c98 on hv-cinder-85944 Sep 28 07:27:06.097591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e25f4e0e-6fab-4058-b742-ba1ceab40d73 req-6037d8ea-c5d2-4c40-ab0b-5ddbe5184614 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049468 Sep 28 07:27:06.098497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 198/382] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:27:06.234451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:06.248220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-370ad7d7-1a0c-4664-8dda-4856e57852e5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.395226 Sep 28 07:27:06.269578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 185/383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:05 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:06.444766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:06.445806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:06.456977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:06.456977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:06.456977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:06.456977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:06.457543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:06.457543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:06.672997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:06.681168 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ebce494f-b226-45fc-aeae-8eb494dcfd2d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.240893 Sep 28 07:27:06.682002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 199/384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:06 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:06.842452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:06.844117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:06.849007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:06.855661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:06.856158 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:06.856596 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:06.869112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:06.869621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:06.870515 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:07.110687 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:07.119217 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:07.121458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:07.122727 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-315ffa9a-65c5-4437-b661-795282717a2a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.284696 Sep 28 07:27:07.124263 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 186/385] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:06 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:07.277301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:07.278141 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:07.284469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:07.285059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:07.285615 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:07.286572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:07.287407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:07.287882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:07.443518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:07.451981 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-58ed5b5a-f4d6-4b71-a467-a660288d4421 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.178659 Sep 28 07:27:07.452570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 200/386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:07 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:07.706180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:07.706790 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:07.712865 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:07.713388 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:07.713821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:07.714511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:07.714987 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:07.715409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:07.748380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:07.842207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:07.850606 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ea75e61f-1837-4fe1-8f9e-43b49db280a8 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.149054 Sep 28 07:27:07.851191 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 187/387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:07 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:08.154824 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:08.155426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:08.157411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:08.159188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:08.166070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:08.166547 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:08.166976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:08.167681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:08.168126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:08.168548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:08.303770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:08.312022 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:08.314286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:08.316325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-db8d098f-ee52-467e-b87f-ff146c872a06 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1739 microversion: 2.20 time: 0.165465 Sep 28 07:27:08.316898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 201/388] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:08 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:08.477618 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:08.478756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:08.487918 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:08.488515 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:08.489242 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:08.490223 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:08.490897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:08.491683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:08.693365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:08.700039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d94c2260-53b8-4580-a051-06cef7a7a868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.228147 Sep 28 07:27:08.704137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 188/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:08 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:08.872836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:08.873468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:08.879543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:08.880017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:08.880450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:08.881156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:08.881609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:08.882052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:09.019942 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:09.027490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a9ae12a-ecc1-47af-8719-fbe7d2b68c4f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.158576 Sep 28 07:27:09.028052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 202/390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:08 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:09.341623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:09.342382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:09.349289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:09.349769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:09.350197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:09.350880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:09.351712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:09.352460 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:09.565864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:09.574056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:09.575586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:09.577160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0a4eb5a4-c2f8-4ee9-ab5b-03ae43850412 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.239243 Sep 28 07:27:09.577777 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 189/391] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:09 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:09.731514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:09.733606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:09.744525 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:09.745788 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:09.747536 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:09.749126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:09.750152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:09.751146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:10.017540 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:10.027139 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0eb85a0-f176-42f9-8a2d-ed5ae619fe3b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.303601 Sep 28 07:27:10.042856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 203/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:09 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:10.060348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:10.061712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:10.077869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:10.077869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:10.077869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:10.077869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:10.079112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:10.079112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:10.234882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:10.242888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9ff48a65-99a5-4b1f-a9e8-78ecfa55e54a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.194168 Sep 28 07:27:10.243384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 190/393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:10 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:10.603254 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:10.604800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:10.611680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:10.612682 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:10.613229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:10.614101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:10.614560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:10.614987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:10.746741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:10.756083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:10.757534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:10.758688 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-540282ed-31d8-46b7-8c6b-8f295aeb39fd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.159494 Sep 28 07:27:10.759255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 204/394] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:10 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:11.052838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:11.053463 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:11.060155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:11.060631 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:11.061093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:11.061793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:11.062217 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:11.062630 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:11.196145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:11.204200 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-427b2d48-3c4d-4efe-99bc-e965f3b8c57f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.156234 Sep 28 07:27:11.204750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 191/395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:11 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:11.265801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:11.266429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:11.272723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:11.273227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:11.273656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:11.274398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:11.274847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:11.275263 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:11.401283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:11.409340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb5636a7-9098-4f3a-9f49-f18eaa8c050d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.146711 Sep 28 07:27:11.409914 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 205/396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:11 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:11.782839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:11.783452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:11.789420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:11.789902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:11.790339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:11.791025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:11.791478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:11.791899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:11.919349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:11.927595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:11.929051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:11.930197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-59c9ed41-ed1a-450a-ba58-40af7ea6d0f2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.151277 Sep 28 07:27:11.930750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 192/397] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:11 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:12.227131 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:12.227740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:12.234134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:12.234619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:12.235046 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:12.235724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:12.236176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:12.236593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:12.363020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:12.371226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b6965ca8-286a-4954-8cd9-574514d7dd8f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.147969 Sep 28 07:27:12.371790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 206/398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:12 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:12.431549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:12.432348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:12.438723 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:12.439200 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:12.439629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:12.440334 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:12.440816 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:12.441280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:12.573007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:12.580517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-35d5f208-e103-43d8-b35f-5bf7730fc2a2 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.152775 Sep 28 07:27:12.581173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 193/399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:12 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:12.955175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:12.956326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:12.962294 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:12.962767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:12.963192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:12.963859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:12.964299 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:12.964710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:13.089008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:13.097779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:13.099211 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:13.100342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c05558b5-4542-4c39-81f0-b235191c9277 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.149149 Sep 28 07:27:13.100896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 207/400] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:12 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:13.395330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:13.395932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:13.401875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:13.402349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:13.402777 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:13.403451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:13.403897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:13.404308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:13.534018 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:13.542137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2073d6c3-6915-4169-98d5-73420e169579 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.151190 Sep 28 07:27:13.542693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 194/401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:13 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:13.602357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:13.602984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:13.609324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:13.609800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:13.610226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:13.610897 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:13.611342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:13.612252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:13.739642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:13.747630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-32231613-9c36-432d-af22-6f4337a38992 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.149072 Sep 28 07:27:13.748280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 208/402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:13 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:14.125222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:14.125828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:14.131757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:14.132234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:14.132667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:14.133380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:14.133830 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:14.134250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:14.260527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:14.269532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:14.270976 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:14.272121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-421c49b9-4fb9-45cf-9d53-28578ec3654e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.150808 Sep 28 07:27:14.272673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 195/403] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:14 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:14.565835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:14.566436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:14.572327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:14.572798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:14.573256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:14.573940 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:14.574380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:14.574796 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:14.703934 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:14.712336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5275aabd-c1f3-44e9-b841-abd89c11fd88 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.150990 Sep 28 07:27:14.712896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 209/404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:14 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:14.770723 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:14.771355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:14.777737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:14.778218 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:14.778645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:14.779326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:14.779775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:14.780192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:14.912689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:14.920390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4fa459b4-e5d9-4b54-941b-7886190e06a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.153587 Sep 28 07:27:14.921124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 196/405] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:14 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:15.103092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-ec26b3ea-6140-46e4-a2f0-c02f2c57d364 req-3273bb8b-0841-4108-8cef-6c6f83ecc6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268a5985-193b-4474-81f1-3140ec176c98", "name": "network-vif-plugged", "status": "completed", "tag": "8f48e4d9-3822-4acd-8b65-44198c2add90"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:15.113323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec26b3ea-6140-46e4-a2f0-c02f2c57d364 req-3273bb8b-0841-4108-8cef-6c6f83ecc6d1 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.113949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec26b3ea-6140-46e4-a2f0-c02f2c57d364 req-3273bb8b-0841-4108-8cef-6c6f83ecc6d1 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.114218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-ec26b3ea-6140-46e4-a2f0-c02f2c57d364 req-3273bb8b-0841-4108-8cef-6c6f83ecc6d1 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:15.125877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-ec26b3ea-6140-46e4-a2f0-c02f2c57d364 req-3273bb8b-0841-4108-8cef-6c6f83ecc6d1 service nova] Creating event network-vif-plugged:8f48e4d9-3822-4acd-8b65-44198c2add90 for instance 268a5985-193b-4474-81f1-3140ec176c98 on hv-cinder-85944 Sep 28 07:27:15.131130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-ec26b3ea-6140-46e4-a2f0-c02f2c57d364 req-3273bb8b-0841-4108-8cef-6c6f83ecc6d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031938 Sep 28 07:27:15.131721 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 210/406] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:27:15.314308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:15.315062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:15.321030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.321581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.325156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:15.325889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.326384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.326844 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:15.463694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:15.472511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:15.474017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:15.475285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-45cfc860-c0b6-410f-a407-64f169dc2093 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.164877 Sep 28 07:27:15.475837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 197/407] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:15 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:15.736801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:15.737636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:15.744081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.744558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.745008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:15.745696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.746141 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.746566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:15.897080 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:15.908159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4e50b042-cd1a-4a75-9fd3-f56fbf6c369f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.175940 Sep 28 07:27:15.909357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 211/408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:15 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:15.944924 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:15.945545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:15.952068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.952485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.952913 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:15.953617 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:15.954062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:15.954475 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:16.085133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:16.092818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f54b4bf7-7c6a-4eb3-bf0e-9edfa9eb41dd tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.151733 Sep 28 07:27:16.093433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 198/409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:15 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:16.506126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:16.506737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:16.512635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:16.513151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:16.513580 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:16.514291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:16.514741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:16.515159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:16.653094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:16.664150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:16.665706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:16.667058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c28a6832-bd8d-42b8-a77f-fb1c945829ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.164911 Sep 28 07:27:16.667952 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 212/410] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:16 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:16.931611 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:16.932497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:16.938316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:16.938797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:16.939232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:16.939919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:16.940367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:16.940786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:17.076481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:17.091825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cf914fee-5d76-4ccd-bc0a-9d09c2a3c738 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.163986 Sep 28 07:27:17.092407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 199/411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:16 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:17.116136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:17.116983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:17.123392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:17.123880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:17.124317 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:17.125032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:17.125490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:17.125912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:17.141404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:17.149999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-146e8bd8-30a3-4310-a1d5-1e3457aa4663 req-43e63437-0ce9-463f-823b-2bfd97ab5d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "name": "network-vif-unplugged", "status": "completed", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:17.159586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-146e8bd8-30a3-4310-a1d5-1e3457aa4663 req-43e63437-0ce9-463f-823b-2bfd97ab5d69 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:17.160134 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-146e8bd8-30a3-4310-a1d5-1e3457aa4663 req-43e63437-0ce9-463f-823b-2bfd97ab5d69 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:17.160654 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-146e8bd8-30a3-4310-a1d5-1e3457aa4663 req-43e63437-0ce9-463f-823b-2bfd97ab5d69 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:17.163230 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:17.172759 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-146e8bd8-30a3-4310-a1d5-1e3457aa4663 req-43e63437-0ce9-463f-823b-2bfd97ab5d69 service nova] Creating event network-vif-unplugged:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:27:17.178013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-146e8bd8-30a3-4310-a1d5-1e3457aa4663 req-43e63437-0ce9-463f-823b-2bfd97ab5d69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031731 Sep 28 07:27:17.178602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 200/412] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:27:17.255891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:17.263765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bfaae1b3-6279-46cd-9a25-7996d8b47b45 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.151998 Sep 28 07:27:17.264331 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 213/413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:17 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:17.693226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:17.693919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:17.700593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:17.700682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:17.701097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:17.701784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:17.702336 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:17.702626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:17.838445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:17.867238 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:17.868703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:17.869901 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-517c3d37-b931-4d6b-b340-3399892b20af tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1721 microversion: 2.20 time: 0.180931 Sep 28 07:27:17.870468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 201/414] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:17 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:18.115799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:18.116411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:18.122579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:18.123143 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:18.123571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:18.124272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:18.124716 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:18.125169 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:18.251795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:18.260473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99976ad0-3e6e-4581-8925-5f58e8bce1f0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.148694 Sep 28 07:27:18.261194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 214/415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:18 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:18.286974 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:18.287586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:18.293931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:18.294418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:18.294857 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:18.295568 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:18.296024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:18.296446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:18.430760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:18.438973 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9cedd880-3112-4fdd-b316-43215a2d1480 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.156805 Sep 28 07:27:18.439533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 202/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:18 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:18.896363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:18.897086 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:18.902916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:18.903449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:18.903880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:18.904691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:18.905568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:18.906057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.048266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:19.063255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:19.064881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:19.066668 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9ea99b0e-e0df-4429-bad5-11b811e123c5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1724 microversion: 2.20 time: 0.173905 Sep 28 07:27:19.074192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 215/417] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:18 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:19.094550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b71c0ae1-86e6-46ab-b2ef-8883588d4f53"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:19.096836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:19.103624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.104107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.104541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.105279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.105733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.106154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.235634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:19.236249 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:19.244004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.244496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.244999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.245695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.246286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.246717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.388294 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:19.396630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f13df98c-e2b5-4fe1-9283-32726cd685a1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1594 microversion: 2.1 time: 0.164726 Sep 28 07:27:19.397380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 216/418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:19 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:19.410896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:19.411248 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:19.414378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-769ab22e-78ce-4877-a3ea-639444021dfb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323608 Sep 28 07:27:19.414995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 203/419] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Sep 28 07:27:19 2022] POST /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:27:19.421717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.422429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.423007 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.423661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.424119 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.424565 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.461921 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:19.462690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:19.469126 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.469838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.470445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.471495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.472893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.473589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.579702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:19.588721 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b761b0ab-46a0-4284-8b06-5313c17366ca tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.182717 Sep 28 07:27:19.589345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 217/420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:19 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:19.593986 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:19.594749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:19.602426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.603798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.604393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.605277 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.605737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.606154 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.630570 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:19.638762 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-260518e8-f2ed-4de6-a2b1-a614b9a1cb5d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.180593 Sep 28 07:27:19.639336 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 204/421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:19 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:19.676888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 07:27:19.750061 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-671e4162-6bf5-47f3-a998-1759f8df1922 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/action" status: 202 len: 0 microversion: 2.20 time: 0.159506 Sep 28 07:27:19.754614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 218/422] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 07:27:19 2022] POST /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:27:19.760200 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:19.761066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:19.767024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.767854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.767970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.768612 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:19.769950 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:19.769950 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:19.986153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:20.000578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:20.003877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:20.005577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f6ef95f3-bfe0-44c5-a64c-63b5237ff3fc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1810 microversion: 2.20 time: 0.249287 Sep 28 07:27:20.006789 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 205/423] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:19 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:20.612218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:20.613165 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:20.622892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:20.623674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:20.624935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:20.627668 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:20.629761 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:20.630576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:20.663684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:20.664307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:20.676262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:20.679963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:20.680300 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:20.681260 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:20.682035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:20.682455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:20.904515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:20.918418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7c2a4dc7-bd84-430c-9dca-4ec0271d9980 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.309164 Sep 28 07:27:20.933011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 219/424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:20 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:20.939301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:20.948453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7e3c6f6d-2d7b-4776-beea-0dfb002f775f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1372 microversion: 2.1 time: 0.290577 Sep 28 07:27:20.950002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 206/425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:20 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:21.032407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:21.033065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:21.054558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.055569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:21.056025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:21.057009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.057609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:21.058039 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:21.208827 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:21.218103 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:21.219666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:21.220980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-049e5ef3-62c3-45f9-af1c-1b5517600ada tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1750 microversion: 2.20 time: 0.192864 Sep 28 07:27:21.221704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 220/426] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:21 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1750 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:21.889050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-bbfbd109-52ce-46e6-9c92-09dc694043be req-a3b94dfc-2adc-4ba8-be72-5a37a6c36219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:21.899249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bbfbd109-52ce-46e6-9c92-09dc694043be req-a3b94dfc-2adc-4ba8-be72-5a37a6c36219 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.899748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bbfbd109-52ce-46e6-9c92-09dc694043be req-a3b94dfc-2adc-4ba8-be72-5a37a6c36219 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:21.900183 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bbfbd109-52ce-46e6-9c92-09dc694043be req-a3b94dfc-2adc-4ba8-be72-5a37a6c36219 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:21.912354 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-bbfbd109-52ce-46e6-9c92-09dc694043be req-a3b94dfc-2adc-4ba8-be72-5a37a6c36219 service nova] Creating event network-changed:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:27:21.918045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-bbfbd109-52ce-46e6-9c92-09dc694043be req-a3b94dfc-2adc-4ba8-be72-5a37a6c36219 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032591 Sep 28 07:27:21.922882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 207/427] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:27:21.943889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:21.945399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:21.959206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.959792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:21.960237 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:21.961014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.961641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:21.962084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:21.974765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:21.975460 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:21.992970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.994428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:21.995071 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:21.997223 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:21.998001 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:22.000155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:22.273506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:22.291823 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ca10186-12c8-4418-b18c-e25d7ad327c3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.352392 Sep 28 07:27:22.292416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 221/428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:21 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:22.304723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:22.305455 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:22.312031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:22.316783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:22.317511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:22.318595 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:22.319192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:22.319763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:22.336358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:22.345765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-61960973-5ae3-4ebb-876e-3a477084d35f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1566 microversion: 2.1 time: 0.376574 Sep 28 07:27:22.346705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 208/429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:21 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1566 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:22.380248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:22.380919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:22.390797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:22.392030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:22.392841 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:22.394150 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:22.396115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:22.396769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:22.564669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:22.576842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:22.578436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:22.580087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-443dcf55-bf81-43fe-b4f8-39da4ed5130a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1752 microversion: 2.20 time: 0.285734 Sep 28 07:27:22.581142 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 222/430] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:22 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:22.591559 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7c4c4750-e272-49d4-9718-8aac1aa5efd0 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.217903 Sep 28 07:27:22.592167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 209/431] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:27:22 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:27:23.318374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:23.318999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:23.325389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:23.326063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:23.326753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:23.327593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:23.328193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:23.328764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:23.618774 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:23.619783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:23.628033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:23.629587 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:23.630454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:23.632744 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:23.633275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:23.633718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:23.823891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:23.840968 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cbcd29c5-b0b7-4d87-a0a7-8718895a37d0 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.526347 Sep 28 07:27:23.841899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 223/432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:23 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:23.864019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:23.873676 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:23.875983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:23.880724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-18e71f29-00c4-4cc8-930c-66d2251e8120 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.268058 Sep 28 07:27:23.893576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 210/433] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:23 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:23.976097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1162801177"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:23.976641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:23.983704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:23.984199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:23.989670 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:23.990423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:23.990900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:23.991334 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:24.249387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Adding security group d0c88958-8ce1-4a5d-95cc-305617bd617e to port 6f031da6-bf17-41ab-9430-71bbd4ddf1d8 Sep 28 07:27:24.704570 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-7f958530-dc35-47af-8e0d-9f73f8748829 req-25e0bd04-9d8c-4d07-a0f3-2dda6dff4bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268a5985-193b-4474-81f1-3140ec176c98", "tag": "8f48e4d9-3822-4acd-8b65-44198c2add90"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:24.715492 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-7f958530-dc35-47af-8e0d-9f73f8748829 req-25e0bd04-9d8c-4d07-a0f3-2dda6dff4bb1 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:24.720545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-7f958530-dc35-47af-8e0d-9f73f8748829 req-25e0bd04-9d8c-4d07-a0f3-2dda6dff4bb1 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:24.721255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-7f958530-dc35-47af-8e0d-9f73f8748829 req-25e0bd04-9d8c-4d07-a0f3-2dda6dff4bb1 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:24.734802 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-7f958530-dc35-47af-8e0d-9f73f8748829 req-25e0bd04-9d8c-4d07-a0f3-2dda6dff4bb1 service nova] Creating event network-changed:8f48e4d9-3822-4acd-8b65-44198c2add90 for instance 268a5985-193b-4474-81f1-3140ec176c98 on hv-cinder-85944 Sep 28 07:27:24.741196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-7f958530-dc35-47af-8e0d-9f73f8748829 req-25e0bd04-9d8c-4d07-a0f3-2dda6dff4bb1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040001 Sep 28 07:27:24.742656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 211/434] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:27:24.868536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:24.870298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:24.877779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:24.878435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:24.878979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:24.879710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:24.880178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:24.880614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:25.078811 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6d0130e-6a98-414c-b8d8-c15f25917c6d tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/action" status: 202 len: 0 microversion: 2.1 time: 1.107344 Sep 28 07:27:25.079960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 224/435] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:27:23 2022] POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/action => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:27:25.090009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:25.090554 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:25.120073 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:25.120568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:25.125377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:25.127390 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:25.128028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:25.130350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:25.261952 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:25.277109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-974c4f03-00be-4124-b557-a4c2e04e939e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.411757 Sep 28 07:27:25.279688 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 212/436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:24 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:25.292628 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:25.293690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:25.307062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:25.312564 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:25.313473 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:25.314548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:25.315153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:25.316345 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:25.452050 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:25.466142 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:25.468026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:25.470059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66fa8acb-dcb6-4d11-9465-c7eff3e5101a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.388926 Sep 28 07:27:25.471144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 225/437] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:25 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:25.630684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:25.641300 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-92f48e00-d375-4f64-b949-8ce3eacca3b0 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1760 microversion: 2.1 time: 0.360282 Sep 28 07:27:25.642321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 213/438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:25 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1760 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:26.307738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:26.309209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:26.315692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:26.316774 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:26.317304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:26.317999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:26.318473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:26.318895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:26.484159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:26.495235 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1182d26-784e-4f5a-a05e-0a31057e7410 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.191475 Sep 28 07:27:26.497240 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 226/439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:26 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:26.509117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:26.510063 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:26.518497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:26.520348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:26.521167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:26.522077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:26.522534 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:26.523355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:26.691477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:26.700376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:26.701881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:26.703101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d3ec56c1-b196-47c5-9742-e1aa9cbb4659 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.199352 Sep 28 07:27:26.703865 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 214/440] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:26 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:26.761635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-5cd61eba-e992-45e5-b9fd-94d46acc8b9a req-98e5fce9-c587-402c-ae34-4a988989f1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:26.771537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5cd61eba-e992-45e5-b9fd-94d46acc8b9a req-98e5fce9-c587-402c-ae34-4a988989f1d6 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:26.772012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5cd61eba-e992-45e5-b9fd-94d46acc8b9a req-98e5fce9-c587-402c-ae34-4a988989f1d6 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:26.772434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-5cd61eba-e992-45e5-b9fd-94d46acc8b9a req-98e5fce9-c587-402c-ae34-4a988989f1d6 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:26.783140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-5cd61eba-e992-45e5-b9fd-94d46acc8b9a req-98e5fce9-c587-402c-ae34-4a988989f1d6 service nova] Creating event network-changed:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:27:26.789045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-5cd61eba-e992-45e5-b9fd-94d46acc8b9a req-98e5fce9-c587-402c-ae34-4a988989f1d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031077 Sep 28 07:27:26.789630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 227/441] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:27:27.518440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:27.519704 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:27.526219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:27.526702 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:27.527127 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:27.527846 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:27.528289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:27.528701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:27.666457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:27.686546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9bef4017-93d3-446d-bed4-df8b31c5c75e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.171779 Sep 28 07:27:27.687161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 215/442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:27 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:27.730056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:27.731378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:27.739386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:27.739866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:27.740297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:27.741011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:27.741463 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:27.741880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:27.877500 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:27.887617 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:27.889363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:27.890676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be60315e-a1b2-47ec-8fd3-6dc7f65ead34 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.165475 Sep 28 07:27:27.891891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 228/443] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:27 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:28.710488 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:28.711179 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:28.718063 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:28.718552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:28.719414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:28.719710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:28.720362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:28.720785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:28.738990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:28.856101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:28.865215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-85e4019a-9d46-4ba8-81a4-e9e449645d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.159052 Sep 28 07:27:28.865793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 216/444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:28 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:28.916712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:28.917341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:28.923841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:28.924330 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:28.924766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:28.926388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:28.926854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:28.927283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:29.088895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:29.102401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:29.105041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:29.106429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f840333f-b2da-4bd0-9a9e-a32d53ce6ee5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.193601 Sep 28 07:27:29.121704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 229/445] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:28 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:27:29.889500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:29.890448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:29.898252 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:29.898824 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:29.899331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:29.900105 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:29.900688 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:29.901202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:30.036652 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:30.044860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e54f19e7-48fe-47ed-ba59-f4ee9a5bea13 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.159293 Sep 28 07:27:30.045452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 217/446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:29 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:30.133328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:30.133965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:30.140630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:30.141092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:30.141532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:30.142221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:30.142671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:30.143092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:30.148139 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:30.282633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:30.292533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:30.294099 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:30.295334 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f2f12cd-4459-40ae-ad8f-6b47b85efaf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.166259 Sep 28 07:27:30.296008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 230/447] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:30 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:31.070186 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:31.070946 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:31.077485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:31.077961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:31.078384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:31.079069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:31.079514 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:31.079930 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:31.211280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:31.219273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fe1ecac0-db17-4da0-8eaa-05a7c226d6a8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.154274 Sep 28 07:27:31.219831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 218/448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:31 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:31.320387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:31.321054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:31.327021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:31.327506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:31.327940 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:31.328626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:31.329107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:31.329532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:31.464321 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:31.477598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:31.479151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:31.485805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09d17498-d913-4d64-a73c-aac4564cc0ee tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.169624 Sep 28 07:27:31.486478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 231/449] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:31 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:32.242377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:32.242993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:32.249533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:32.250007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:32.250433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:32.251146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:32.251590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:32.252003 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:32.388080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:32.397256 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-efde93eb-979f-46b5-927b-66d3dd6d32f6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.158913 Sep 28 07:27:32.397834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 219/450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:32 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:32.513703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:32.514301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:32.521377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:32.521956 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:32.522388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:32.523125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:32.523578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:32.523997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:32.666497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:32.676288 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:32.678709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:32.680171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6d8c9fda-a96a-4658-80b1-e7c8d326a8d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.170587 Sep 28 07:27:32.680729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 232/451] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:32 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:33.421092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:33.421665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:33.428065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:33.428537 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:33.428986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:33.429666 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:33.430111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:33.430522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:33.561917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:33.571713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2ce7c875-22f1-40b5-9675-a21afed1292f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.154515 Sep 28 07:27:33.572388 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 220/452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:33 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:33.710715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:33.712084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:33.718327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:33.718803 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:33.719230 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:33.719913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:33.720355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:33.720767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:33.853189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:33.862399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:33.864416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:33.865644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-63ac5055-066f-4825-8ea9-7bfc9bbc5636 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.162808 Sep 28 07:27:33.866203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 233/453] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:33 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:34.595957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:34.597567 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:34.605247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:34.605818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:34.606322 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:34.607133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:34.607652 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:34.608161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:34.763089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:34.772772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ad09397e-7ceb-4a19-87f3-29a8edc83d75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.180687 Sep 28 07:27:34.773741 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 221/454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:34 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:34.895094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:34.896886 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:34.904471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:34.905251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:34.905791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:34.907106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:34.907997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:34.908528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:35.076308 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:35.088449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:35.090007 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:35.091250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b4e44edf-2fe2-44d1-afab-d383827626ea tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.202998 Sep 28 07:27:35.091943 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 234/455] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:34 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:35.799410 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:35.800694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:35.808828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:35.809359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:35.809796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:35.810503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:35.810957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:35.811375 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:35.954714 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:35.963529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a83a7054-64ac-4f5b-8b03-b6d913fdef2d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.167834 Sep 28 07:27:35.964104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 222/456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:35 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:36.119638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:36.120243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:36.122547 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:36.127960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:36.128452 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:36.128887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:36.130387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:36.130849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:36.131270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:36.269163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:36.279123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:36.280605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:36.281798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-56e6a9b9-87a4-45d9-a8d3-1cfef783080b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.166183 Sep 28 07:27:36.282390 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 235/457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:36 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:36.987613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:36.988254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:36.990850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=74 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:36.996367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:36.996880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:36.997337 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:36.998036 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:36.998491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:36.998913 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:37.130344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:37.139089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f593b938-800f-4ca1-b58e-82cd660091dc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.155438 Sep 28 07:27:37.139647 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 223/458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:36 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:37.309991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:37.310605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:37.316912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:37.317502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:37.317928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:37.318601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:37.319045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:37.319457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:37.456636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:37.465935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:37.467356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:37.468495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95ce406e-da21-4a38-835d-0c1e405f7aa9 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.162613 Sep 28 07:27:37.469070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 236/459] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:37 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:38.163384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:38.164019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:38.170767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:38.171251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:38.171680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:38.172371 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:38.172815 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:38.173257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:38.308796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:38.319181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5357147f-6566-4028-a1e6-9701dcaff04b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.159594 Sep 28 07:27:38.320327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 224/460] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:38 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:38.495548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:38.496177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:38.502577 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:38.502990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:38.503439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:38.504113 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:38.504750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:38.505173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:38.642342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:38.652975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:38.654710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:38.655886 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-95776660-8436-4468-8b08-e13f93f6a1f4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.164203 Sep 28 07:27:38.665241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 237/461] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:38 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:39.342740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:39.343489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:39.350673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:39.351154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:39.351585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:39.352278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:39.352731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:39.353233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:39.482183 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:39.490634 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-764a2d4b-02f7-4391-b736-a362536f2b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1721 microversion: 2.1 time: 0.151949 Sep 28 07:27:39.491197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 225/462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:39 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:39.684173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:39.685004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:39.692495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:39.692994 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:39.693425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:39.694117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:39.694561 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:39.694975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:39.827971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:39.836455 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:39.837930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:39.839074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f4de28bc-741e-432e-be85-7809b0dfc609 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.159411 Sep 28 07:27:39.839632 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 238/463] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:39 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:40.514655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:40.515327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:40.523413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.523900 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.524331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.525240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.525696 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.526128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.658113 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:40.667030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-64ac85e7-1c64-43fa-824f-b456e6baf064 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1698 microversion: 2.1 time: 0.156458 Sep 28 07:27:40.667593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 226/464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:40 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:40.691758 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ec084ca-4d09-4d97-8aac-6f4a26bb9908 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:40.694681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 07:27:40.694836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Wed Sep 28 07:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action (ip 10.222.0.52) !!! Sep 28 07:27:40.702253 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ec084ca-4d09-4d97-8aac-6f4a26bb9908 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.702744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ec084ca-4d09-4d97-8aac-6f4a26bb9908 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.703180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ec084ca-4d09-4d97-8aac-6f4a26bb9908 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.764680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ec084ca-4d09-4d97-8aac-6f4a26bb9908 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Going to try to start instance {{(pid=120452) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 07:27:40.816209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ec084ca-4d09-4d97-8aac-6f4a26bb9908 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action" status: 202 len: 0 microversion: 2.1 time: 0.128168 Sep 28 07:27:40.816894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 239/465] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:27:40 2022] POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:27:40.824786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:40.825417 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:40.831326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.831796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.832220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.833439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.833881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.834294 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.865337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:40.866065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:40.872160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.872638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.873107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.873781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:40.874242 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:40.875085 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:40.965929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:40.974213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-50a7855c-4c9c-4c51-bfde-c06841cf6fb1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1707 microversion: 2.1 time: 0.153096 Sep 28 07:27:40.974788 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 227/466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:40 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:41.010869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:41.019261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:41.021281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:41.022414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5cb718c-1409-4250-8b2d-ed36571f0407 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.161364 Sep 28 07:27:41.022972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 240/467] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:40 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:27:41.997201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:41.997816 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:42.000124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 07:27:42.000275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Wed Sep 28 07:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af (ip 10.222.0.52) !!! Sep 28 07:27:42.008728 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:42.009240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:42.009668 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:42.010365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:42.010813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:42.011232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:42.047796 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:42.048469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:42.056053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:42.056733 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:42.057529 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:42.058300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:42.058826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:42.059475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:42.202936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:42.212678 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:42.214192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:42.215352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-be79bf93-c238-46ee-a343-1e93e3bd5d17 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.171456 Sep 28 07:27:42.216079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 241/468] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:42 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:27:42.479817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:42.487820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a2fa2bcb-cc5e-44c2-a4d4-8e120b04fbc8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1707 microversion: 2.1 time: 0.494546 Sep 28 07:27:42.488378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 228/469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:41 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1707 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:43.242939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:43.243525 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:43.249825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:43.250296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:43.250720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:43.251421 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:43.251858 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:43.252269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:43.388123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:43.396648 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:43.399202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:43.401090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a11699e4-39a6-4fd9-82bb-900429506c33 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.162590 Sep 28 07:27:43.401936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 242/470] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:43 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:43.511362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:43.511928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:43.518481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:43.518967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:43.519400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:43.520742 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:43.521475 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:43.521905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:43.659593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:43.668464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3c84368d-e342-4093-b7fa-8fd03e0c2671 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1707 microversion: 2.1 time: 0.161006 Sep 28 07:27:43.669078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 229/471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:43 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:27:44.438149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:44.438817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:44.445207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:44.445680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:44.446106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:44.446780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:44.447219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:44.447631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:44.574480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:44.584645 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:44.586047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:44.587210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03906a86-c7f3-44b1-ada5-6c14ec002787 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.153035 Sep 28 07:27:44.587767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 243/472] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:44 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:44.693353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:44.693958 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:44.700419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:44.700993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:44.701508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:44.703043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:44.703275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:44.703701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:44.835467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:44.843446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-37f85e57-ec10-4b6b-b0de-c123899370b5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1711 microversion: 2.1 time: 0.154530 Sep 28 07:27:44.844008 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 230/473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:27:44 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:27:45.614239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:45.614850 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:45.621507 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:45.621982 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:45.622406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:45.623099 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:45.623539 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:45.623951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:45.752748 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:45.761564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:45.763269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:45.764763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd38be33-f4b1-4a28-ae2b-3631f1d36074 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.155105 Sep 28 07:27:45.765360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 244/474] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:45 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:46.790299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:46.790904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:46.797377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:46.797849 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:46.798277 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:46.798955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:46.799395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:46.799804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:46.927196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:46.936643 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:46.938185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:46.939342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f3ab4d1f-28a5-414c-b651-45328d7e139e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.152931 Sep 28 07:27:46.939891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 231/475] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:46 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:47.964624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:47.965252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:47.971633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:47.972113 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:47.972540 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:47.973254 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:47.973702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:47.974136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:48.118277 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:48.120518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:48.128562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:48.130832 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:48.132031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5cfaa077-0e09-42fe-b63f-b7a195ad6473 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.171326 Sep 28 07:27:48.132600 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 245/476] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:47 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:49.157164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:49.157791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:49.163839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:49.164323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:49.164756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:49.165464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:49.165923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:49.166342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:49.299778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:49.308650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:49.310120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:49.311276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a37d2b09-448c-467c-a774-60d2ee291baf tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.158017 Sep 28 07:27:49.311837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 232/477] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:49 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:50.338860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:50.339453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:50.346535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:50.346950 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:50.347377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:50.348775 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:50.349253 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:50.349667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:50.480536 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:50.489110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:50.490571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:50.491718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c96154d3-9a58-44e2-9ac4-f9607149e445 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.157421 Sep 28 07:27:50.492276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 246/478] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:50 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:51.299734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-d11355a1-67b3-40fd-846a-556c5b950bf5 req-765e9713-b7e7-47ad-a437-e87f9e0301e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "name": "network-vif-plugged", "status": "completed", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:27:51.311011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-d11355a1-67b3-40fd-846a-556c5b950bf5 req-765e9713-b7e7-47ad-a437-e87f9e0301e7 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:51.311489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-d11355a1-67b3-40fd-846a-556c5b950bf5 req-765e9713-b7e7-47ad-a437-e87f9e0301e7 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:51.311915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-d11355a1-67b3-40fd-846a-556c5b950bf5 req-765e9713-b7e7-47ad-a437-e87f9e0301e7 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:51.315642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:27:51.324095 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-d11355a1-67b3-40fd-846a-556c5b950bf5 req-765e9713-b7e7-47ad-a437-e87f9e0301e7 service nova] Creating event network-vif-plugged:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:27:51.329154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-d11355a1-67b3-40fd-846a-556c5b950bf5 req-765e9713-b7e7-47ad-a437-e87f9e0301e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033013 Sep 28 07:27:51.329906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 233/479] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:27:51.515693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:51.516240 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:51.523003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:51.523480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:51.523908 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:51.524587 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:51.525062 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:51.525494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:51.661443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:51.670077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:51.671503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:51.672967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-330c7a65-6b21-4b24-a4eb-54b7eeec8c0f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.161221 Sep 28 07:27:51.673555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 247/480] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:51 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:27:52.700204 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:52.701022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:52.707477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:52.707982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:52.708426 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:52.709215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:52.709659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:52.710072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:52.843552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:52.852449 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:52.853944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:52.855112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e18aeaa6-64f0-4dd5-b96b-e8fe26b1176f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.159627 Sep 28 07:27:52.855854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 234/481] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:52 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:53.919782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:53.919782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:53.919782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:53.919782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:53.926029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:53.926029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:53.926029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:53.926029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:54.059794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:54.068613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:54.070098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:54.071254 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-212ee1cb-7747-4f74-8958-0479adc03d2d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.185594 Sep 28 07:27:54.071810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 248/482] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:53 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:55.096757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:55.097387 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:55.104964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:55.105454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:55.105876 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:55.106563 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:55.107009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:55.107429 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:55.242756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:55.251924 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:55.253401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:55.254551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-579206f4-22d2-4fd0-bbd4-6a0abd1a4b83 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1808 microversion: 2.20 time: 0.161829 Sep 28 07:27:55.255107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 235/483] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:55 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:27:56.279855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:27:56.280459 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:27:56.287005 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:56.287480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:56.287904 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:56.288575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:27:56.289055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:27:56.289473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:27:56.420790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:56.433310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:56.434765 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:27:56.435964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d121a91c-5609-4eb4-9b11-4da9a66c174d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1795 microversion: 2.20 time: 0.160028 Sep 28 07:27:56.436518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 249/484] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:27:56 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:28:17.182206 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:28:17.184715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:17.187028 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=25 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:17.187692 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=13 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:17.193756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:17.194246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:17.194679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:17.195407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:17.195858 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:17.196297 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:17.267245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6f03bc5c-0f47-4996-bcd8-a73b2e3e884e tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.088766 Sep 28 07:28:17.267801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 236/485] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:28:17 2022] POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:28:17.276549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:17.277232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:17.279285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=29 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:17.279935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=25 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:17.286931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:17.287548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:17.288253 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:17.289300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:17.289759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:17.290187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:17.432250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:17.441100 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f5e3ca6f-355b-42b0-af8c-c92d8bfc59be tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1752 microversion: 2.1 time: 0.169089 Sep 28 07:28:17.441671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 250/486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:17 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:18.465932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:18.466542 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:18.472665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:18.473177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:18.473608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:18.474291 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:18.474739 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:18.475160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:18.622650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:18.630769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ebffb212-bd11-4ee5-988f-a363822302b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.169746 Sep 28 07:28:18.631322 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 237/487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:18 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:19.655709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:19.656352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:19.663106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:19.663597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:19.664031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:19.664741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:19.665219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:19.665641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:19.806017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:19.815384 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0972422f-7f5c-4c88-87ae-f8933eb49a4f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.163624 Sep 28 07:28:19.815952 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 251/488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:19 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:20.840104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:20.840705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:20.847130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:20.847603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:20.848031 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:20.848758 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:20.849261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:20.849681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:20.989353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:20.998202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a534fc7e-4c53-4b1b-bacc-c67ecdb667f1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.162673 Sep 28 07:28:20.998771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 238/489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:20 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:22.022128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:22.022661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:22.029664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:22.030144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:22.030570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:22.031247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:22.031690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:22.032104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:22.171468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:22.179563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78f9539d-f80e-4a6d-ae5b-97185ba24b13 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.161345 Sep 28 07:28:22.180135 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 252/490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:22 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:23.203343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:23.203952 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:23.210374 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:23.210847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:23.211274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:23.211956 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:23.212407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:23.213358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:23.349344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:23.358285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-da34da0c-60ac-4731-a5fd-05b6a337bca7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.158757 Sep 28 07:28:23.358842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 239/491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:23 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:24.381506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:24.382049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:24.388414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:24.388899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:24.389362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:24.390043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:24.390492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:24.390910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:24.533008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:24.541799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9c9c7c44-f3d3-4c67-8042-4c631fcfa8db tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.164140 Sep 28 07:28:24.542460 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 253/492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:24 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:25.566480 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:25.567083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:25.574201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:25.574689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:25.575130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:25.575822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:25.576307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:25.576731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:25.718791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:25.726874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1c310061-6697-4e76-b0b2-526f2d4eff6a tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.164238 Sep 28 07:28:25.727439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 240/493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:25 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:26.752130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:26.753569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:26.761090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:26.761577 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:26.762009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:26.762727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:26.763175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:26.763593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:26.907957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:26.916244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1c96b9c-c8cd-49f0-b02e-dca293ec35b1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.169092 Sep 28 07:28:26.916953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 254/494] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:26 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:27.940783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:27.941369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:27.947814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:27.948770 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:27.949225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:27.949909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:27.950358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:27.950775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:28.086990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:28.095553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d45c3a7c-ddd2-4567-8df7-9be8be7c5f79 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.158714 Sep 28 07:28:28.096115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 241/495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:27 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:29.119302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:29.119933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:29.126791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:29.127279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:29.127745 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:29.128439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:29.128896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:29.129348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:29.268490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:29.277333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a18492d4-a968-409b-bff7-356a32c7ab66 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.161791 Sep 28 07:28:29.277898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 255/496] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:29 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:30.301094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:30.301737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:30.308386 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:30.308865 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:30.309885 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:30.310585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:30.311037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:30.311458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:30.457296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:30.466394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-aa9e0d01-680e-41c2-996d-85dff47a32c7 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.169208 Sep 28 07:28:30.466960 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 242/497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:30 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:31.490252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:31.490859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:31.496870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:31.497389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:31.497819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:31.498495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:31.498946 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:31.499427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:31.636335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:31.644500 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88a82d76-d01c-472a-b6ef-c20cc69d3922 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.158261 Sep 28 07:28:31.645094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 256/498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:31 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:32.669520 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:32.670126 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:32.676483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:32.677033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:32.677418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:32.678099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:32.678546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:32.678965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:32.820788 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:32.829339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7a3fa9ed-bb2b-471d-9aa0-4d0b747874a8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.164183 Sep 28 07:28:32.829902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 243/499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:32 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:33.360609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82bb2e8f-4c78-4d65-b4df-4a0f959bea69"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:28:33.363095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:33.369560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:33.370045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:33.370812 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:33.371505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:33.371962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:33.372386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:33.658423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46ec05ea-d148-4938-962b-6c7b6e7ca7d9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302031 Sep 28 07:28:33.659098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 257/500] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:28:33 2022] POST /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:28:33.852312 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:33.852959 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:33.862418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:33.863162 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:33.863838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:33.864889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:33.865623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:33.866274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:34.018683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:34.026754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bed2cd23-e3a9-40e0-a523-cef6be987ca1 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.178289 Sep 28 07:28:34.027313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 244/501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:33 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:35.052596 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:35.053325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:35.060013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:35.060488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:35.060918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:35.061620 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:35.062069 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:35.062489 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:35.202943 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:35.211013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-99e84629-ce4a-483d-85b6-0dda41a2be77 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.163129 Sep 28 07:28:35.211571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 258/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:35 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:36.235128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:36.235740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:36.242151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:36.242675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:36.243112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:36.243799 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:36.244253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:36.244681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:36.388044 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:36.396189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c96e1d5d-2364-488c-8155-53fa8b250984 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.164984 Sep 28 07:28:36.396852 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 245/503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:36 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:37.420087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:37.420699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:37.427076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:37.427549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:37.427979 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:37.428655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:37.429136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:37.429559 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:37.569634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:37.578725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b833c73-a78b-48c8-8a7b-cfcb1232acf2 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.162608 Sep 28 07:28:37.579287 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 259/504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:37 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:38.602682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:38.603222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:38.609247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:38.609725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:38.610159 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:38.610837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:38.611286 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:38.611701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:38.750261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:38.758725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cde1dc26-37d1-4693-8d4d-2b995f376987 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.160129 Sep 28 07:28:38.759419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 246/505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:38 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:39.782926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:39.783537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:39.789936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:39.790413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:39.790845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:39.791529 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:39.791980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:39.792396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:39.951457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:39.959642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e3c04119-39c2-44da-8850-5652b702f2d9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1757 microversion: 2.1 time: 0.180523 Sep 28 07:28:39.960146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 260/506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:39 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:28:40.986615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:40.987135 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:40.993527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:40.993999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:40.994425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:40.995094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:40.995537 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:40.995953 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:41.143730 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:41.151882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-af213ce6-4cfd-472a-9207-44f0652ee7ee tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1760 microversion: 2.1 time: 0.169215 Sep 28 07:28:41.152445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 247/507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:40 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:42.258509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:28:42.260833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:42.267239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:42.267710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:42.268137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:42.268807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:42.269286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:42.269702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:42.291570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'flavor' on Instance uuid 268a5985-193b-4474-81f1-3140ec176c98 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:28:42.411733 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-498b4e35-be67-44a9-83de-1dce171b486e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/action" status: 200 len: 32 microversion: 2.1 time: 0.157003 Sep 28 07:28:42.412273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 261/508] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:28:42 2022] POST /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:28:42.422223 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:42.422834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:42.429320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:42.429811 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:42.430244 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:42.430940 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:42.431385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:42.431803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:42.646384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:42.655144 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-05e92520-e1ac-4122-8dc7-6f8e071b30dc tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.237254 Sep 28 07:28:42.655717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 248/509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:42 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:43.680090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:43.680786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:43.688359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:43.688842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:43.689301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:43.689988 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:43.690439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:43.690865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:43.818502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:43.826583 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f574f629-f1b0-43d0-a6db-257bd8947f4a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.151259 Sep 28 07:28:43.827137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 262/510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:43 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:44.849637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:44.850246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:44.856705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:44.857214 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:44.857645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:44.858330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:44.858781 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:44.859201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:44.983332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:44.991405 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-65065df2-4963-4e7b-90b3-03be8c84e99a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.145579 Sep 28 07:28:44.991971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 249/511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:44 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:46.015410 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:46.015937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:46.022237 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:46.022714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:46.023138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:46.023807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:46.024251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:46.024664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:46.029418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:46.154739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:46.162893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0c64e14d-cf9b-4dba-82ca-cc5f50c09682 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.152027 Sep 28 07:28:46.163456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 263/512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:46 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:47.096589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:47.097156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:47.103494 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:47.103978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:47.104415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:47.105139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:47.105593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:47.106020 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:47.186065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:47.186669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:47.192970 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:47.193454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:47.193884 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:47.194568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:47.195012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:47.195426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:47.225132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:47.234881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lazy-loading 'services' on Instance uuid 475e52e8-57f8-4c53-b01d-52e19d35a1af {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:28:47.323472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:47.331779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d80f382-5a83-459c-bcff-64af9cfdb304 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.149849 Sep 28 07:28:47.332360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 264/513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:47 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:28:47.357261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8f4ae0e3-e0fc-45aa-94c3-00018aa2efba tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-volume_attachments/a44a5034-679d-4fe4-aa38-8010ea5dd975" status: 202 len: 0 microversion: 2.1 time: 0.263693 Sep 28 07:28:47.357903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 250/514] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:28:47 2022] DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-volume_attachments/a44a5034-679d-4fe4-aa38-8010ea5dd975 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:28:48.355172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:48.355780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:48.358269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=31 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:48.365232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:48.365727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:48.366279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:48.367510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:48.367975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:48.368447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:48.483262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4b43dd01-9874-4753-ab83-3a35f3d07a28 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:28:48.485383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=31 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:48.490912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4b43dd01-9874-4753-ab83-3a35f3d07a28 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:48.491472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4b43dd01-9874-4753-ab83-3a35f3d07a28 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:48.491990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4b43dd01-9874-4753-ab83-3a35f3d07a28 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:48.506865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:48.515475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8c6e2d78-4da8-4cc7-b07a-4fd2b7970270 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.164089 Sep 28 07:28:48.516136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 265/515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:48 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:48.516516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4b43dd01-9874-4753-ab83-3a35f3d07a28 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Going to try to stop instance {{(pid=120451) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 07:28:48.556572 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4b43dd01-9874-4753-ab83-3a35f3d07a28 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action" status: 202 len: 0 microversion: 2.1 time: 0.077851 Sep 28 07:28:48.557316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 251/516] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:28:48 2022] POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:28:48.566229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:48.566828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:48.572571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:48.573084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:48.573517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:48.574306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:48.574742 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:48.575247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:48.705028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:48.712696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-71f44bc6-2628-448e-8d7d-68898021d5b6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.150276 Sep 28 07:28:48.713353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 266/517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:48 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:28:49.539899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:49.540592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:49.547642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:49.548122 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:49.548562 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:49.549275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:49.549728 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:49.550145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:49.681224 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:49.689658 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-62ab1603-fc4b-406d-a1e6-3128056c62c6 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.154611 Sep 28 07:28:49.690226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 252/518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:49 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:49.735555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:49.736188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:49.742613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:49.743085 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:49.743519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:49.744188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:49.744637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:49.745076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:49.871320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:49.878946 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-215ceab1-d140-4ebe-8760-a611a684cf65 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.147386 Sep 28 07:28:49.879510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 267/519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:49 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:50.713250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:50.713860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:50.720231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:50.720709 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:50.721179 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:50.721868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:50.722315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:50.722734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:50.849441 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:50.858810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d71b41d7-d1b5-49cc-b429-f2a2075fd36b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.149413 Sep 28 07:28:50.859435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 253/520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:50 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:50.901299 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:50.901901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:50.908787 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:50.909291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:50.909720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:50.910392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:50.910839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:50.911256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:51.039707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:51.048362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2897ce50-12ad-4e27-9c9b-a3f56d84898b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.150826 Sep 28 07:28:51.048928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 268/521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:50 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:51.881987 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:51.882552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:51.889886 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:51.890361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:51.890791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:51.891471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:51.891919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:51.892335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:52.022084 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:52.030117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e9cbd528-2267-4625-aecf-dfa3e25d4423 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.152051 Sep 28 07:28:52.030679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 254/522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:51 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:52.071780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:52.072387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:52.079224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:52.079720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:52.080136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:52.080815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:52.081291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:52.081736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:52.213604 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:52.221845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26beb34e-fe26-43f5-ad28-ffa3b9834b46 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.153834 Sep 28 07:28:52.222406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 269/523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:52 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:53.054900 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:53.055540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:53.062489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:53.063011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:53.063445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:53.064128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:53.064578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:53.065022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:53.188854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:53.196969 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b5ba7100-d6a8-4bdf-8eb1-71bdcbadc228 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.145871 Sep 28 07:28:53.197542 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 255/524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:53 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:53.244987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:53.245626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:53.252172 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:53.252651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:53.253176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:53.253860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:53.254311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:53.254732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:53.379017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:53.386664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5095034f-8197-4545-a694-4f9287da731c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.145532 Sep 28 07:28:53.387227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 270/525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:53 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:54.219882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:54.220491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:54.226890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:54.227370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:54.227801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:54.228478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:54.228927 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:54.229368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:54.352302 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:54.361133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-dfe9c591-c708-4a86-a68e-86698fa20329 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.145309 Sep 28 07:28:54.361690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 256/526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:54 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:54.410874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:54.411486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:54.417986 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:54.418470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:54.418905 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:54.420310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:54.420907 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:54.421359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:54.551824 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:54.559833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6e0774d4-430f-4e7e-9801-e4341ffafd0b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.153072 Sep 28 07:28:54.560865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 271/527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:54 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:55.048299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:55.048913 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:55.054822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.055298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.055725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.056402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.056846 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.057286 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.085813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-657b7958-2398-4622-b03e-83a7ee3786a2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments/b71c0ae1-86e6-46ab-b2ef-8883588d4f53" status: 200 len: 194 microversion: 2.20 time: 0.041485 Sep 28 07:28:55.086380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 257/528] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Sep 28 07:28:55 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments/b71c0ae1-86e6-46ab-b2ef-8883588d4f53 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:28:55.159235 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:55.159723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:55.165611 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.166106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.166514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.167191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.167637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.168053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.290409 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lazy-loading 'services' on Instance uuid 85725e51-be6a-4dc2-9438-347c786282f0 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:28:55.384361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:55.385002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:55.392444 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.392959 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.393477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.394178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.394631 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.395053 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.405030 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-75cc57e5-1486-48ec-93dd-3031b3ee4bd5 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments/b71c0ae1-86e6-46ab-b2ef-8883588d4f53" status: 202 len: 0 microversion: 2.20 time: 0.249630 Sep 28 07:28:55.405723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 272/529] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Sep 28 07:28:55 2022] DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments/b71c0ae1-86e6-46ab-b2ef-8883588d4f53 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:28:55.414241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:55.416562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:55.423739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.424220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.424841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.425563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.426009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.426428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.461629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e6d51f33-3317-48ee-a7a5-bb15a7513526 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051433 Sep 28 07:28:55.462267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 273/530] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 07:28:55 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 07:28:55.534323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:55.542601 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-97208701-07de-4be9-83c8-0318fbfa453d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.162096 Sep 28 07:28:55.543219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 258/531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:55 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:28:55.582682 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:55.583286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:55.589151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.589631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.590057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.590734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:55.591187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:55.591600 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:55.719680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:55.727510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f8f1a9ef-79be-4b02-8932-7b3090cbe123 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.148607 Sep 28 07:28:55.728472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 274/532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:55 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:56.474503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:56.476741 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:56.483084 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.483556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.483982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.484655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.485156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.485592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.514234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3cf67388-8243-4de4-8097-e58e91bbc2bc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043741 Sep 28 07:28:56.514763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 259/533] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 07:28:56 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:56.565595 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:56.566290 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:56.572592 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.573393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.573826 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.574509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.574957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.575375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.578417 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:56.578939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:56.584711 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.585227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.585664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.586347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.586798 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.587217 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.616176 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:28:56.706600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c4f724a5-9f87-4df5-aa8f-62ae9f2971f0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 204 len: 0 microversion: 2.20 time: 0.132200 Sep 28 07:28:56.707234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 260/534] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 07:28:56 2022] DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 07:28:56.716974 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:56.717673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:56.724130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.725362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.726041 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.726734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.727183 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.728353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.892691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:56.902759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f42e6ef4-1ff4-4f98-8cdf-c341592fa337 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.340808 Sep 28 07:28:56.904688 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 275/535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:56 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:56.909573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:56.910173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:56.915588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:56.915923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.916406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.916836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.917573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:56.918019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:56.918759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:56.924545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:56.925997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:56.927136 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-af2ad6d7-bad7-42c4-9e10-4f27fc746e13 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.214952 Sep 28 07:28:56.927686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 261/536] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:28:56 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:28:57.044458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:57.052880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-cefe0604-e2cb-4a42-8cc1-e3511195bb42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.148049 Sep 28 07:28:57.053478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 276/537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:56 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:57.929185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:57.929783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:57.937132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:57.937615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:57.938023 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:57.938698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:57.939144 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:57.939557 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:57.953072 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:57.953660 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:57.960576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:57.961094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:57.961528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:57.962214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:57.962662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:57.963079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:58.071982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:58.080253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-06db8de7-5e4d-4caf-9b9d-861510b8ade5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.154958 Sep 28 07:28:58.080817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 262/538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:57 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:58.085178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:58.085771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:58.091328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:58.091803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:58.092226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:58.093115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:58.093721 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:58.094137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:58.099494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:58.108045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:58.109519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:58.110672 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-df91f3f8-497b-46af-ad03-29861a16ec6c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.161684 Sep 28 07:28:58.111227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 277/539] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:28:57 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:28:58.221684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:58.229327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c832395d-1d25-4f82-a5c5-e4936426b37a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1675 microversion: 2.1 time: 0.147523 Sep 28 07:28:58.229893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 263/540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:58 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:59.103298 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:59.103896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:59.110272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.110740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.111167 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.111837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.112281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.112696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.136593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:59.137219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:59.145665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.146197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.146869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.147558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.148163 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.148581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.151422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:59.257319 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:59.266863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7b1a303e-77b4-48ab-883d-3c7eaf39e3b5 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.167250 Sep 28 07:28:59.267843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 278/541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:59 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:59.272562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:59.273271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:59.279356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.279989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.280434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.281148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.281834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.282425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.286706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:28:59.347729 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:59.357992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:59.359626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:59.361164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3331ed64-9f66-43b4-93ce-5d2d4e37d952 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1723 microversion: 2.20 time: 0.228338 Sep 28 07:28:59.361909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 264/542] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:28:59 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:28:59.426744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:59.434861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13664827-ccde-47ea-a296-03e87acf18f7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1652 microversion: 2.1 time: 0.165810 Sep 28 07:28:59.435614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 279/543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:59 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:28:59.457490 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-57aa4be1-9fcb-4735-99e4-c5e0243f9c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:28:59.463406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57aa4be1-9fcb-4735-99e4-c5e0243f9c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.463885 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57aa4be1-9fcb-4735-99e4-c5e0243f9c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.464309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-57aa4be1-9fcb-4735-99e4-c5e0243f9c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.487415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-57aa4be1-9fcb-4735-99e4-c5e0243f9c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Going to try to start instance {{(pid=120451) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 07:28:59.533082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-57aa4be1-9fcb-4735-99e4-c5e0243f9c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action" status: 202 len: 0 microversion: 2.1 time: 0.079037 Sep 28 07:28:59.533597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 265/544] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:28:59 2022] POST /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:28:59.541626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:28:59.542228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:28:59.548251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.548730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.549188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.549865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:28:59.550348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:28:59.550772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:28:59.680257 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:28:59.688971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bdd5e0c-d509-4e68-b361-4d3a75c56928 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1661 microversion: 2.1 time: 0.151133 Sep 28 07:28:59.689750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 280/545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:28:59 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:00.154663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-815bc516-82c8-4d17-8a91-9455f7f44d0a req-65b95585-8fd9-490e-b944-93d43f14b443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85725e51-be6a-4dc2-9438-347c786282f0", "name": "network-vif-deleted", "tag": "a5ca836c-b241-4501-9e8a-0a676dc640ae"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:00.164301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-815bc516-82c8-4d17-8a91-9455f7f44d0a req-65b95585-8fd9-490e-b944-93d43f14b443 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.164861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-815bc516-82c8-4d17-8a91-9455f7f44d0a req-65b95585-8fd9-490e-b944-93d43f14b443 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.165383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-815bc516-82c8-4d17-8a91-9455f7f44d0a req-65b95585-8fd9-490e-b944-93d43f14b443 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.176380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-815bc516-82c8-4d17-8a91-9455f7f44d0a req-65b95585-8fd9-490e-b944-93d43f14b443 service nova] Creating event network-vif-deleted:a5ca836c-b241-4501-9e8a-0a676dc640ae for instance 85725e51-be6a-4dc2-9438-347c786282f0 on hv-cinder-85944 Sep 28 07:29:00.181317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-815bc516-82c8-4d17-8a91-9455f7f44d0a req-65b95585-8fd9-490e-b944-93d43f14b443 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031958 Sep 28 07:29:00.181907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 266/546] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:00.290661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:00.291313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:00.298225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.298644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.299114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.299815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.300266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.300688 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.387653 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:00.389325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:00.398427 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.399443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.400115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.400924 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.401629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.402516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.436656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:00.449507 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d69690fa-5d35-4cf4-ad42-85eeb501305a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.162814 Sep 28 07:29:00.451518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 281/547] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:00 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:00.483796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:00.493051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:00.495059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:00.496493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a7677bf6-bc0e-461b-8076-be9605834aac tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1655 microversion: 2.20 time: 0.113874 Sep 28 07:29:00.498259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 267/548] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:00 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:29:00.713380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:00.714332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:00.722354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.723085 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.723944 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.725137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:00.725763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:00.726453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:00.901049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:00.912608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9114bbcb-0c67-4d6e-8bbc-2b82409ef066 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1661 microversion: 2.1 time: 0.202980 Sep 28 07:29:00.929002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 282/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:00 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1661 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:01.473718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:01.474353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:01.480800 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.481269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.481698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:01.482966 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.483418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.483838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:01.523551 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:01.524156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:01.530291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.530768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.531198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:01.531890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.532338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.532755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:01.564701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.565212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.565641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:01.566078 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lazy-loading 'fault' on Instance uuid 85725e51-be6a-4dc2-9438-347c786282f0 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:29:01.611232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:01.619355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:01.620840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:01.622024 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e93d6093-9620-4be9-80aa-74c1f4da9a52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 200 len: 1370 microversion: 2.20 time: 0.102275 Sep 28 07:29:01.623336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 283/550] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:01 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:29:01.632011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:01.641078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-30ffe697-b411-485a-942b-b8eea62b23fb tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.171115 Sep 28 07:29:01.641684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 268/551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:01 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:01.940911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:01.941533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:01.947357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.947834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.948262 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:01.948964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:01.949408 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:01.949817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:02.083545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:02.093742 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3519402d-cbd2-415a-93da-d813d78926e4 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1661 microversion: 2.1 time: 0.156815 Sep 28 07:29:02.094336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 284/552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:01 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:02.647854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:02.648463 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:02.655471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:02.655948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:02.656377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:02.657088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:02.657536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:02.657954 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:02.665522 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:02.666125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:02.671347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] HTTP exception thrown: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:29:02.672238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:02.672721 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Request method failure captured: Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 HTTP/1.1 Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_ahU4l9AF4kI1WsaYAIlwV8cw-7g4mo7_BHbBEjPmK9flIBc9f1Smzat7Tla0245YHmiBZOAyWwa5yh1RWhCm-MqV6HVPN0wvUK-TliluJFoN9ie5Er65oz546lqeBVV25cDvgkaSLLtZT7G1nKDNpbKh97G_jhauKom6S0GMrFyRo Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:29:02.673025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60646ef7a4ad4eb1860952504092742d", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 764cfe23613e4a97ba05f8bf0ed77ef1 Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:29:02.674626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '85725e51-be6a-4dc2-9438-347c786282f0'} Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:29:02.675552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:29:02.677111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:02.678700 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:02.678804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Returning 404 to user: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:29:02.678900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:02.678900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:02.679076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fb2565b2-5039-4838-8628-1d5a3af0bbf3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 404 len: 111 microversion: 2.20 time: 0.030424 Sep 28 07:29:02.679177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:02.679322 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 269/553] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:02 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:29:02.682965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a08ff608-9a9e-4b2c-a2e8-42981fbd6c30 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '.version_select at 0x7fa862377ca0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:02.706185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a08ff608-9a9e-4b2c-a2e8-42981fbd6c30 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991585320" status: 204 len: 0 microversion: 2.20 time: 0.026651 Sep 28 07:29:02.706755 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 270/554] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Sep 28 07:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991585320 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 07:29:02.887442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:02.895738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-06f18809-0faf-4bef-9c6c-c0ac41ee7b76 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1736 microversion: 2.1 time: 0.233923 Sep 28 07:29:02.896307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 285/555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:02 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:29:03.118354 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:03.119260 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:03.127346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:03.127837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:03.128425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:03.128998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:03.129455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:03.129878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:03.306572 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:03.314972 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5ca9cc40-3c6f-4c9d-82de-71ea6d9d6fb3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1661 microversion: 2.1 time: 0.200633 Sep 28 07:29:03.315754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 271/556] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:03 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1661 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:03.698044 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-70d8a7d6-4834-47d2-baf0-c7caff26f6dd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'create', calling method: .version_select at 0x7fa861fb0790>, body: {"keypair": {"name": "tempest-keypair-1525533996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1xkQndoX6D5yquFqiBvwBeSPTYpOo12RhuA88U2dTijQMWN1CAU9jKIN66hN2PtYS3KEaDzM1HHYdhhBwjb+W9+d3Wip5Wo/ErCckeFK7q2kB18XXgtAP17Zw1JHNWhg=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:03.714509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-70d8a7d6-4834-47d2-baf0-c7caff26f6dd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for project 60646ef7a4ad4eb1860952504092742d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:29:03.718734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-70d8a7d6-4834-47d2-baf0-c7caff26f6dd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for user 764cfe23613e4a97ba05f8bf0ed77ef1 and project 60646ef7a4ad4eb1860952504092742d. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:29:03.745196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-70d8a7d6-4834-47d2-baf0-c7caff26f6dd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051364 Sep 28 07:29:03.745785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 286/557] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Sep 28 07:29:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 07:29:03.921120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:03.921737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:03.927999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:03.928585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:03.929122 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:03.929879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:03.930419 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:03.930921 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.068928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:04.077984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-da3ccbc7-8cf4-4b3b-a4d8-c7cdf711d53e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1716 microversion: 2.1 time: 0.161478 Sep 28 07:29:04.078549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 272/558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:03 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:04.199636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:04.200126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:04.205984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.206447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.206878 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.207556 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.208000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.208412 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.296629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] HTTP exception thrown: Cannot 'detach_volume' instance 268a5985-193b-4474-81f1-3140ec176c98 while it is in vm_state rescued Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Request method failure captured: Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments/82bb2e8f-4c78-4d65-b4df-4a0f959bea69 HTTP/1.1 Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aedx0GaOLcT8p38w3Cu7oXV8RXsgepU8W30147Vp_LPN9AKSfFIcayr_DcvqSz5UZviIa-kgfyPfCBolaMQZR11x4crY6KUXnKu86HSGx-ulIR389kAdPlOGWLdzRYr3RjfPpSdk4XmdubfYOM0MFPz7yV3FFLIOIMpclNMGA0Mhg Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:29:04.298538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc7675d275394d8893d0facf20d3a4e7", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: d286b1e0afe9413291e0e2503b4c204a Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:29:04.300066 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Cannot 'detach_volume' instance 268a5985-193b-4474-81f1-3140ec176c98 while it is in vm_state rescued Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'server_id': '268a5985-193b-4474-81f1-3140ec176c98', 'id': '82bb2e8f-4c78-4d65-b4df-4a0f959bea69'} Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 268a5985-193b-4474-81f1-3140ec176c98 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:29:04.300760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 268a5985-193b-4474-81f1-3140ec176c98 while it is in vm_state rescued Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 268a5985-193b-4474-81f1-3140ec176c98 while it is in vm_state rescued Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:04.302112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Returning 409 to user: Cannot 'detach_volume' instance 268a5985-193b-4474-81f1-3140ec176c98 while it is in vm_state rescued {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:29:04.303193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f746d485-98a8-4e16-ae6d-fe4e1cdb0589 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments/82bb2e8f-4c78-4d65-b4df-4a0f959bea69" status: 409 len: 152 microversion: 2.1 time: 0.104276 Sep 28 07:29:04.303887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 287/559] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:29:04 2022] DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments/82bb2e8f-4c78-4d65-b4df-4a0f959bea69 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 07:29:04.309265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:04.309884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:04.315672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.316266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.316698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.317491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.317940 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.318382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.340410 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:04.342011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:04.350476 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.351213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.351824 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.352890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.353655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.354232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.393331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b1cf2d72-7b1b-4ea0-8e6f-5a92dd7cbee9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "POST /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/action" status: 202 len: 0 microversion: 2.1 time: 0.087544 Sep 28 07:29:04.396979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 273/560] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:29:04 2022] POST /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 07:29:04.402385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:04.403059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:04.409719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.410198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.410621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.411332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:04.411855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:04.412272 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:04.577447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:04.586727 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7312504e-5ad9-412c-b4df-f74203c51fc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1724 microversion: 2.1 time: 0.188330 Sep 28 07:29:04.587668 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 274/561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:04 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:29:04.779496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:04.788909 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0b27e427-dbaa-44ab-89fd-7f9466080b42 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1661 microversion: 2.1 time: 0.453737 Sep 28 07:29:04.790201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 288/562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:04 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1661 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:29:05.302997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-949152925", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad570fd1-a088-4600-9208-cf0f3843e053"}], "security_groups": [{"name": "tempest-securitygroup--1420815453"}], "key_name": "tempest-keypair-1525533996", "user_data": "}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:05.415674 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] validate_networks() for [('ad570fd1-a088-4600-9208-cf0f3843e053', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:29:05.612011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:05.612621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:05.618907 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:05.619389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:05.619818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:05.620512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:05.620975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:05.621415 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:05.758060 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:05.766448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b026758-8356-45f2-a661-d0a0051241fa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1724 microversion: 2.1 time: 0.158335 Sep 28 07:29:05.767028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 289/563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:05 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:29:05.815512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:05.816223 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:05.822777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:05.823272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:05.823850 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:05.825140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:05.825743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:05.826426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:05.837739 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:29:05.838181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:29:05.838837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:29:05.839240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:29:05.839642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:29:05.849937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:05.850415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:05.850835 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:05.851551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:05.851995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:05.852409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:05.879012 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for project 60646ef7a4ad4eb1860952504092742d. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:29:05.886625 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Getting quotas for user 764cfe23613e4a97ba05f8bf0ed77ef1 and project 60646ef7a4ad4eb1860952504092742d. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:29:05.899008 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:29:05.901367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:29:05.952670 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c7f1bfa8-1c00-463c-872c-62e1381ff043 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.654397 Sep 28 07:29:05.953296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 275/564] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Sep 28 07:29:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 07:29:05.965250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-76185ee2-8992-4d60-9225-ceb7c84e7851 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:05.966724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-76185ee2-8992-4d60-9225-ceb7c84e7851 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:05.974421 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:05.983795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-46647a7d-e6f8-4619-b700-0539e8d5add3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1665 microversion: 2.1 time: 0.172198 Sep 28 07:29:05.985008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 290/565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:05 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:29:06.020936 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-76185ee2-8992-4d60-9225-ceb7c84e7851 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:06.029088 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-76185ee2-8992-4d60-9225-ceb7c84e7851 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:06.030710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-76185ee2-8992-4d60-9225-ceb7c84e7851 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:06.031786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-76185ee2-8992-4d60-9225-ceb7c84e7851 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1281 microversion: 2.20 time: 0.070670 Sep 28 07:29:06.032336 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 276/566] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:05 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:29:06.796234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:06.796835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:06.803186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:06.803740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:06.804131 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:06.804786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:06.805259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:06.805674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:06.939825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:06.948323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7177e519-a4f8-4295-8b27-db4fecbe09b1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1724 microversion: 2.1 time: 0.156556 Sep 28 07:29:06.948888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 291/567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:06 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:07.055904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:07.056452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:07.063922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:07.064083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:07.064394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:07.065107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:07.065556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:07.065973 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:07.127270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:07.135403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:07.136838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:07.138461 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ffa50e15-ce08-40fc-b604-280c808163d0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1277 microversion: 2.20 time: 0.085954 Sep 28 07:29:07.139006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 277/568] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:07 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:07.972746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:07.973764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:07.984099 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:07.984614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:07.985081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:07.985782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:07.986239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:07.986663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:08.121000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:08.129881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f0be43e-46d1-43ff-ab51-3aac5d5c3526 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1730 microversion: 2.1 time: 0.161270 Sep 28 07:29:08.130454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 292/569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:07 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:08.152570 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:08.153095 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:08.159874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:08.160351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:08.160778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:08.161489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:08.161939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:08.162349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:08.163877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:08.164489 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:08.170701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:08.171183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:08.171614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:08.172302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:08.172754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:08.173199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:08.241658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:08.250807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:08.252403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:08.253530 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0ee5fd6a-2907-465b-bfaa-39eac3b3070a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1333 microversion: 2.20 time: 0.093476 Sep 28 07:29:08.254307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 293/570] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:08 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:29:08.297161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-31622a4f-7509-43f2-8c22-ce0c406575a3 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148299 Sep 28 07:29:08.297781 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 278/571] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:29:08 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:09.222192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9daef4d7-b327-4fda-b6a4-a18117c815ee req-1e3e8271-0e28-4e1f-a808-acd7fc166853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268a5985-193b-4474-81f1-3140ec176c98", "tag": "8f48e4d9-3822-4acd-8b65-44198c2add90"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:09.239601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9daef4d7-b327-4fda-b6a4-a18117c815ee req-1e3e8271-0e28-4e1f-a808-acd7fc166853 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:09.240464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9daef4d7-b327-4fda-b6a4-a18117c815ee req-1e3e8271-0e28-4e1f-a808-acd7fc166853 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:09.241146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9daef4d7-b327-4fda-b6a4-a18117c815ee req-1e3e8271-0e28-4e1f-a808-acd7fc166853 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:09.257725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9daef4d7-b327-4fda-b6a4-a18117c815ee req-1e3e8271-0e28-4e1f-a808-acd7fc166853 service nova] Creating event network-changed:8f48e4d9-3822-4acd-8b65-44198c2add90 for instance 268a5985-193b-4474-81f1-3140ec176c98 on hv-cinder-85944 Sep 28 07:29:09.264527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9daef4d7-b327-4fda-b6a4-a18117c815ee req-1e3e8271-0e28-4e1f-a808-acd7fc166853 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050291 Sep 28 07:29:09.265786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 294/572] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:09.280680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:09.281983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:09.289026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:09.289791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:09.290659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:09.291570 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:09.292207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:09.292826 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:09.393626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:09.402919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:09.405295 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:09.406717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0c98c0ac-1db9-465c-8c9d-d70995e950f7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1339 microversion: 2.20 time: 0.130803 Sep 28 07:29:09.410951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 279/573] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:09 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:29:10.434416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:10.435781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:10.442308 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:10.442716 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:10.443144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:10.443828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:10.444284 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:10.444700 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:10.580268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:10.588373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:10.589878 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:10.590990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-958fa711-f6cf-4030-b872-c0f9018d8438 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.161844 Sep 28 07:29:10.591651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 295/574] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:10 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:10.795399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-4729a3fc-6dd3-4791-9b60-53b33a66fa3a req-3dcc602e-ec66-4925-9f79-3976e8e5fcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:10.816407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-4729a3fc-6dd3-4791-9b60-53b33a66fa3a req-3dcc602e-ec66-4925-9f79-3976e8e5fcd8 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:10.823476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-4729a3fc-6dd3-4791-9b60-53b33a66fa3a req-3dcc602e-ec66-4925-9f79-3976e8e5fcd8 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:10.824237 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-4729a3fc-6dd3-4791-9b60-53b33a66fa3a req-3dcc602e-ec66-4925-9f79-3976e8e5fcd8 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:10.837414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-4729a3fc-6dd3-4791-9b60-53b33a66fa3a req-3dcc602e-ec66-4925-9f79-3976e8e5fcd8 service nova] Creating event network-changed:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:29:10.843682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-4729a3fc-6dd3-4791-9b60-53b33a66fa3a req-3dcc602e-ec66-4925-9f79-3976e8e5fcd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052648 Sep 28 07:29:10.844417 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 280/575] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:11.279275 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-12aa2e7a-09b1-4820-bf06-4587587b1fd6 req-0d350eff-32dc-45ed-94f3-da546513e29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268a5985-193b-4474-81f1-3140ec176c98", "tag": "8f48e4d9-3822-4acd-8b65-44198c2add90"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:11.288807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-12aa2e7a-09b1-4820-bf06-4587587b1fd6 req-0d350eff-32dc-45ed-94f3-da546513e29f service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:11.289311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-12aa2e7a-09b1-4820-bf06-4587587b1fd6 req-0d350eff-32dc-45ed-94f3-da546513e29f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:11.289735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-12aa2e7a-09b1-4820-bf06-4587587b1fd6 req-0d350eff-32dc-45ed-94f3-da546513e29f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:11.300395 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-12aa2e7a-09b1-4820-bf06-4587587b1fd6 req-0d350eff-32dc-45ed-94f3-da546513e29f service nova] Creating event network-changed:8f48e4d9-3822-4acd-8b65-44198c2add90 for instance 268a5985-193b-4474-81f1-3140ec176c98 on hv-cinder-85944 Sep 28 07:29:11.305665 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-12aa2e7a-09b1-4820-bf06-4587587b1fd6 req-0d350eff-32dc-45ed-94f3-da546513e29f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030122 Sep 28 07:29:11.306255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 296/576] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:11.616622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:11.617329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:11.624074 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:11.624556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:11.625005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:11.625694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:11.626138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:11.626552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:12.163752 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:12.173711 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:12.175173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:12.176307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d8f7cfe0-1cb1-42a4-91a7-46b7b9102a50 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.563934 Sep 28 07:29:12.176866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 281/577] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:11 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:13.203431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:13.204121 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:13.210196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:13.210676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:13.211107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:13.211784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:13.212232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:13.212650 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:13.340479 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:13.344095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:13.349598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:13.351034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:13.352129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1005cad9-c9dc-4591-8101-c3e12f054cb7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.154103 Sep 28 07:29:13.352685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 297/578] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:13 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:14.376061 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:14.376658 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:14.383243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:14.383714 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:14.384142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:14.384813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:14.385321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:14.385733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:14.509756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:14.520069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:14.521535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:14.522629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a885b89a-52cb-430d-a1e1-0f25169058eb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.150564 Sep 28 07:29:14.523173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 282/579] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:14 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:15.548438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:15.548975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:15.550763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:15.556559 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:15.557087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:15.557515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:15.558201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:15.558902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:15.559316 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:15.687646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:15.696585 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:15.698497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:15.699622 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1a165fae-de2c-41e5-bd67-5bed516d3970 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.155894 Sep 28 07:29:15.713126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 298/580] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:15 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:16.725128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:16.725735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:16.728115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:16.729005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=8 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:16.735677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:16.736164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:16.736595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:16.737320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:16.737770 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:16.738189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:16.869466 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:16.871650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:16.879990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:16.881508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:16.882650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-54149044-d65b-4b98-9145-4d73b8309187 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.161433 Sep 28 07:29:16.883238 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 283/581] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:16 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:17.746658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f065b09a-6281-47a4-a242-ec832dfe5684 req-13171969-aeae-4e03-9e18-54c6c3194ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "name": "network-vif-plugged", "status": "completed", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:17.758202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f065b09a-6281-47a4-a242-ec832dfe5684 req-13171969-aeae-4e03-9e18-54c6c3194ee8 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:17.758687 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f065b09a-6281-47a4-a242-ec832dfe5684 req-13171969-aeae-4e03-9e18-54c6c3194ee8 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:17.759292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f065b09a-6281-47a4-a242-ec832dfe5684 req-13171969-aeae-4e03-9e18-54c6c3194ee8 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:17.771174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f065b09a-6281-47a4-a242-ec832dfe5684 req-13171969-aeae-4e03-9e18-54c6c3194ee8 service nova] Creating event network-vif-plugged:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:29:17.776275 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f065b09a-6281-47a4-a242-ec832dfe5684 req-13171969-aeae-4e03-9e18-54c6c3194ee8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Sep 28 07:29:17.776869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 299/582] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:17.907094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:17.907742 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:17.915524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:17.916013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:17.916459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:17.917184 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:17.917639 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:17.918059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:18.102235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:18.110764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:18.112243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:18.113403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ed011115-0f27-447d-ab2e-eb781b9fd66c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.210257 Sep 28 07:29:18.113960 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 284/583] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:17 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:19.139714 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:19.140406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:19.142776 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:19.148063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:19.148574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:19.149017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:19.149695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:19.150138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:19.150553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:19.283026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:19.290881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:19.292339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:19.293453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-33979d70-9b04-4717-9a09-9d0473412fe0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1407 microversion: 2.20 time: 0.158641 Sep 28 07:29:19.294013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 300/584] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:19 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:20.374978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:20.375593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:20.377456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:20.382728 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:20.383211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:20.383645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:20.384346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:20.384800 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:20.385254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:20.517232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:20.525303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:20.526754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:20.527915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-df675877-98eb-4ced-8775-028e0c06fd52 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1599 microversion: 2.20 time: 0.212418 Sep 28 07:29:20.529299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 285/585] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:29:20 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:29:20.552611 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:20.553146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:20.560217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:20.560778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:20.561501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:20.562203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:20.562625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:20.563039 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:20.638237 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-276fe1f3-1aea-4916-bc3f-450d7e82d70a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088954 Sep 28 07:29:20.638823 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 301/586] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Sep 28 07:29:20 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:29:21.732447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-bfa8a60f-9a4f-43fb-a136-37f570a94e7f req-ca978889-47a4-42e3-ad49-5c1e96b8ac86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:21.742963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bfa8a60f-9a4f-43fb-a136-37f570a94e7f req-ca978889-47a4-42e3-ad49-5c1e96b8ac86 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:21.743540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bfa8a60f-9a4f-43fb-a136-37f570a94e7f req-ca978889-47a4-42e3-ad49-5c1e96b8ac86 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:21.744046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-bfa8a60f-9a4f-43fb-a136-37f570a94e7f req-ca978889-47a4-42e3-ad49-5c1e96b8ac86 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:21.755060 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-bfa8a60f-9a4f-43fb-a136-37f570a94e7f req-ca978889-47a4-42e3-ad49-5c1e96b8ac86 service nova] Creating event network-changed:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:29:21.760363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-bfa8a60f-9a4f-43fb-a136-37f570a94e7f req-ca978889-47a4-42e3-ad49-5c1e96b8ac86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Sep 28 07:29:21.760990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 286/587] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:33.496768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:33.497565 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=18 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:33.501855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1162801177"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:33.502376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:33.509205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:33.509673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:33.510094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:33.510759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:33.511198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:33.511606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:33.636039 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.network.security_group_api [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Removing security group d0c88958-8ce1-4a5d-95cc-305617bd617e from port 6f031da6-bf17-41ab-9430-71bbd4ddf1d8 Sep 28 07:29:33.936125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83feafc8-9cb7-4027-aac4-93f250849430 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.441132 Sep 28 07:29:33.936751 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 302/588] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:29:33 2022] POST /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:29:33.958943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:33.959820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=15 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:34.029163 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-10654b91-003c-43c7-9761-899e98bed5d3 req-939c513d-d26f-4b74-bc0e-e91b23497890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:34.039825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-10654b91-003c-43c7-9761-899e98bed5d3 req-939c513d-d26f-4b74-bc0e-e91b23497890 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:34.040615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-10654b91-003c-43c7-9761-899e98bed5d3 req-939c513d-d26f-4b74-bc0e-e91b23497890 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:34.041085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-10654b91-003c-43c7-9761-899e98bed5d3 req-939c513d-d26f-4b74-bc0e-e91b23497890 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:34.052865 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-10654b91-003c-43c7-9761-899e98bed5d3 req-939c513d-d26f-4b74-bc0e-e91b23497890 service nova] Creating event network-changed:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:29:34.059275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-10654b91-003c-43c7-9761-899e98bed5d3 req-939c513d-d26f-4b74-bc0e-e91b23497890 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101591 Sep 28 07:29:34.060349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 287/589] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:34.953538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:34.954067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:34.959906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:34.960379 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:34.960800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:34.961496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:34.961942 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:34.962353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:35.045064 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lazy-loading 'services' on Instance uuid 8474dd09-0169-47e0-8667-43cb46c2fbd3 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:29:35.120486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a612892-d99c-4bfc-a82c-f3b52995f186 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments/01f62a26-d015-420d-bd06-4b8dd976b71c" status: 202 len: 0 microversion: 2.1 time: 0.171283 Sep 28 07:29:35.121471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 303/590] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:29:34 2022] DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments/01f62a26-d015-420d-bd06-4b8dd976b71c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:29:35.131671 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:35.134060 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:35.141320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:35.141875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:35.142451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:35.143316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:35.143888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:35.144501 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:35.185886 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-31a4d235-eed2-47d0-89b1-3cfd2295bdd9 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059729 Sep 28 07:29:35.186528 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 288/591] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:29:35 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:36.078900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-db52c89f-e8d4-4d52-b79c-acdfd99d35d5 req-82145473-4337-421f-bcc0-60b0c1ccf6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:36.088649 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-db52c89f-e8d4-4d52-b79c-acdfd99d35d5 req-82145473-4337-421f-bcc0-60b0c1ccf6ca service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:36.089147 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-db52c89f-e8d4-4d52-b79c-acdfd99d35d5 req-82145473-4337-421f-bcc0-60b0c1ccf6ca service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:36.089570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-db52c89f-e8d4-4d52-b79c-acdfd99d35d5 req-82145473-4337-421f-bcc0-60b0c1ccf6ca service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:36.100752 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-db52c89f-e8d4-4d52-b79c-acdfd99d35d5 req-82145473-4337-421f-bcc0-60b0c1ccf6ca service nova] Creating event network-changed:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:29:36.105810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-db52c89f-e8d4-4d52-b79c-acdfd99d35d5 req-82145473-4337-421f-bcc0-60b0c1ccf6ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031582 Sep 28 07:29:36.106638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 304/592] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:36.198992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:36.201171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:36.207737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:36.208209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:36.209149 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:36.209840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:36.210289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:36.210705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:36.240856 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e33c1415-57e0-464f-af29-8ee08934b554 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045606 Sep 28 07:29:36.241490 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 289/593] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:29:36 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:29:36.252615 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:36.253213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:36.259149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:36.259619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:36.260043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:36.260713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:36.261189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:36.261600 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:36.336724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] HTTP exception thrown: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 is not attached to volume 01f62a26-d015-420d-bd06-4b8dd976b71c Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Request method failure captured: Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments/01f62a26-d015-420d-bd06-4b8dd976b71c HTTP/1.1 Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_cOEtKK_6uUKYI4QhfoH_CyTffHXLcj4UVQoyyl2pXJEoi7LIMtDjfFPvbI0m9UzbRGqfh4W3u4qG7_iLpMPTlaqv_FksuXroqOfDln0OiQ2ibpddJACV82hvkSzUeNSIwq8zpfzkkFu-shopxq1upwjxv8alPgbn44AvvdjXM1D2U Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: a3324b12312f43ebab7273b438ad9b65 Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-TestMinimumBasicScenario-240992388 Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:29:36.339117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3324b12312f43ebab7273b438ad9b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3324b12312f43ebab7273b438ad9b65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a3324b12312f43ebab7273b438ad9b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a3324b12312f43ebab7273b438ad9b65", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-TestMinimumBasicScenario-240992388 Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: a3324b12312f43ebab7273b438ad9b65 Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestMinimumBasicScenario-240992388 Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-TestMinimumBasicScenario-240992388-project Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 06451ea3cd91471c9b09966516090509 Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-TestMinimumBasicScenario-240992388-project Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:29:36.340759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 is not attached to volume 01f62a26-d015-420d-bd06-4b8dd976b71c Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'server_id': '8474dd09-0169-47e0-8667-43cb46c2fbd3', 'id': '01f62a26-d015-420d-bd06-4b8dd976b71c'} Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 01f62a26-d015-420d-bd06-4b8dd976b71c. Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:29:36.341667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 is not attached to volume 01f62a26-d015-420d-bd06-4b8dd976b71c Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 is not attached to volume 01f62a26-d015-420d-bd06-4b8dd976b71c Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:29:36.343874 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Returning 404 to user: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 is not attached to volume 01f62a26-d015-420d-bd06-4b8dd976b71c {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:29:36.344875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d9ecc10f-d150-4ead-8d2a-43817b2e31a4 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments/01f62a26-d015-420d-bd06-4b8dd976b71c" status: 404 len: 154 microversion: 2.1 time: 0.092235 Sep 28 07:29:36.344875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 305/594] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:29:36 2022] DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3/os-volume_attachments/01f62a26-d015-420d-bd06-4b8dd976b71c => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:29:37.486532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:37.487030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:37.493362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:37.493842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:37.494280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:37.494964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:37.495418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:37.495839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:37.521473 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:29:37.598330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6cb010ed-1fba-42c6-b8c3-19dc85a50a4c tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 204 len: 0 microversion: 2.1 time: 0.116003 Sep 28 07:29:37.598982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 290/595] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:29:37 2022] DELETE /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:29:37.607107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:37.607708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:37.614031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:37.614503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:37.614928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:37.615598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:37.616037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:37.616446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:37.750588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:37.758289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e9c21954-8ca5-4fdc-bda2-d986f2a8c65f tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1554 microversion: 2.1 time: 0.155109 Sep 28 07:29:37.758832 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 306/596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:37 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:38.782637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:38.783330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:38.789308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:38.789784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:38.790209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:38.790887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:38.791339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:38.791754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:38.922081 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:38.929597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-932d4447-a45d-44e4-b72d-174916d4354b tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1554 microversion: 2.1 time: 0.152187 Sep 28 07:29:38.930152 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 291/597] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:38 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:39.953474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:39.954006 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:39.960469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:39.960966 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:39.961394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:39.962068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:39.962507 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:39.962920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:40.087297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:40.095068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-097a2e50-d6be-43c8-aeea-a0d7b23fbfa8 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1554 microversion: 2.1 time: 0.145527 Sep 28 07:29:40.095629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 307/598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:39 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:40.791506 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-f726b742-9d65-4f29-b78d-470db9ec8f24 req-bfa69366-6902-4fa3-af39-0d1c8376ae74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8474dd09-0169-47e0-8667-43cb46c2fbd3", "name": "network-vif-deleted", "tag": "6f031da6-bf17-41ab-9430-71bbd4ddf1d8"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:40.802872 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f726b742-9d65-4f29-b78d-470db9ec8f24 req-bfa69366-6902-4fa3-af39-0d1c8376ae74 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:40.803346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f726b742-9d65-4f29-b78d-470db9ec8f24 req-bfa69366-6902-4fa3-af39-0d1c8376ae74 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:40.803765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f726b742-9d65-4f29-b78d-470db9ec8f24 req-bfa69366-6902-4fa3-af39-0d1c8376ae74 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:40.816089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-f726b742-9d65-4f29-b78d-470db9ec8f24 req-bfa69366-6902-4fa3-af39-0d1c8376ae74 service nova] Creating event network-vif-deleted:6f031da6-bf17-41ab-9430-71bbd4ddf1d8 for instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 on hv-cinder-85944 Sep 28 07:29:40.821443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-f726b742-9d65-4f29-b78d-470db9ec8f24 req-bfa69366-6902-4fa3-af39-0d1c8376ae74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033731 Sep 28 07:29:40.822030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 292/599] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:29:41.117955 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:41.118710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:41.125788 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:41.126270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:41.126703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:41.127387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:41.127833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:41.128251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:41.163794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:41.164284 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:41.164715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:41.165182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lazy-loading 'fault' on Instance uuid 8474dd09-0169-47e0-8667-43cb46c2fbd3 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:29:41.206313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06451ea3cd91471c9b09966516090509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3324b12312f43ebab7273b438ad9b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:29:41.213871 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f9d4eb13-c678-4cac-acf3-925134bfe6e6 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 200 len: 1347 microversion: 2.1 time: 0.099693 Sep 28 07:29:41.214423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 308/600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:41 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:29:42.238734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:42.239421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] [instance: 8474dd09-0169-47e0-8667-43cb46c2fbd3] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:42.245526 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:42.245997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:42.246423 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:42.247098 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:42.247576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:42.248665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:42.261024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] HTTP exception thrown: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 could not be found. Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Request method failure captured: Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 HTTP/1.1 Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_cOEtKK_6uUKYI4QhfoH_CyTffHXLcj4UVQoyyl2pXJEoi7LIMtDjfFPvbI0m9UzbRGqfh4W3u4qG7_iLpMPTlaqv_FksuXroqOfDln0OiQ2ibpddJACV82hvkSzUeNSIwq8zpfzkkFu-shopxq1upwjxv8alPgbn44AvvdjXM1D2U Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: a3324b12312f43ebab7273b438ad9b65 Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-TestMinimumBasicScenario-240992388 Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:29:42.262608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3324b12312f43ebab7273b438ad9b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3324b12312f43ebab7273b438ad9b65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a3324b12312f43ebab7273b438ad9b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a3324b12312f43ebab7273b438ad9b65", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-TestMinimumBasicScenario-240992388 Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: a3324b12312f43ebab7273b438ad9b65 Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-TestMinimumBasicScenario-240992388 Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-TestMinimumBasicScenario-240992388-project Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 06451ea3cd91471c9b09966516090509 Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-TestMinimumBasicScenario-240992388-project Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 could not be found. Sep 28 07:29:42.264097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '8474dd09-0169-47e0-8667-43cb46c2fbd3'} Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 could not be found. Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:29:42.265794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 could not be found. Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 could not be found. Sep 28 07:29:42.267370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:29:42.269171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Returning 404 to user: Instance 8474dd09-0169-47e0-8667-43cb46c2fbd3 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:29:42.269171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a30d4f39-1523-4895-a161-d0e8333aca95 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3" status: 404 len: 111 microversion: 2.1 time: 0.029907 Sep 28 07:29:42.269171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 293/601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:42 2022] GET /compute/v2.1/servers/8474dd09-0169-47e0-8667-43cb46c2fbd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:29:42.273532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48df42e5-8734-44ae-8b9a-9c9b17b96720 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] Calling method '.version_select at 0x7fa865801430>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:42.293359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48df42e5-8734-44ae-8b9a-9c9b17b96720 tempest-TestMinimumBasicScenario-240992388 tempest-TestMinimumBasicScenario-240992388-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-591482661" status: 202 len: 0 microversion: 2.1 time: 0.023592 Sep 28 07:29:42.293898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 309/602] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Sep 28 07:29:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-591482661 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:29:58.131396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:58.137661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:58.144069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:58.145093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:58.162530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:58.163325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:58.163944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:58.175099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:58.175838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:58.179251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:58.324304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'services' on Instance uuid 268a5985-193b-4474-81f1-3140ec176c98 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:29:58.473881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0d147a8c-32c2-4983-b728-2315e3ce14aa tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments/82bb2e8f-4c78-4d65-b4df-4a0f959bea69" status: 202 len: 0 microversion: 2.1 time: 0.353626 Sep 28 07:29:58.474750 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 294/603] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:29:58 2022] DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments/82bb2e8f-4c78-4d65-b4df-4a0f959bea69 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:29:58.481439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:58.482705 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:29:58.493840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:58.495836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:58.509964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:58.510659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:58.511491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:58.512802 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:58.513468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:58.514060 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:58.614835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1fc199ed-047d-4d37-9b02-e7d010b23121 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135587 Sep 28 07:29:58.622392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 310/604] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:29:58 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:29:59.633072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:59.635970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:59.645348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:59.645697 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:59.646439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:59.647481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:59.648326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:59.648915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:59.696901 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-de1fd94f-181c-4957-a9e4-741d42905f19 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067796 Sep 28 07:29:59.698998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 295/605] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:29:59 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:29:59.797769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:59.798502 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:59.804464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:59.804973 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:59.805402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:59.806168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:59.806527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:59.806941 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:59.835031 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:29:59.930598 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e9bf959c-a627-46bf-a9c9-72c24a26803c tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 204 len: 0 microversion: 2.1 time: 0.136880 Sep 28 07:29:59.934730 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 296/606] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:29:59 2022] DELETE /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:29:59.942104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:29:59.942991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:29:59.949667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:59.950280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:59.950809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:59.952591 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:29:59.953321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:29:59.954000 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:29:59.972274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-afeb1e91-22e6-4894-b2a6-c6aa5c81700e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Action: 'create', calling method: .version_select at 0x7fa8657ca0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1817965910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrgKGdngSjE+e6BBzUEKPMmgwU+YlJ8Kq04oizyA18Z+AWT3ZuHqexb9Gf+M9k6UoIWNsIPTPW+On2hPClKn1/6l/qZ3VRAvfUXKjE1Bs8idg/nfSa/UBrlUjsofhm08w=="}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:29:59.995427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-afeb1e91-22e6-4894-b2a6-c6aa5c81700e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:30:00.000259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-afeb1e91-22e6-4894-b2a6-c6aa5c81700e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for user 04cf365443b44d9d87338d95b5b0251b and project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'key_pairs'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:30:00.033481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-afeb1e91-22e6-4894-b2a6-c6aa5c81700e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280254 Sep 28 07:30:00.034810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 311/607] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:29:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:00.117294 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:00.126800 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4a8b1ed5-4b83-4cc2-af9b-fdc1d49f645f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1690 microversion: 2.1 time: 0.190288 Sep 28 07:30:00.127643 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 297/608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:29:59 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:01.151422 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:01.152043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:01.162872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:01.163582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:01.164191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:01.164767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:01.165261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:01.165694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:01.337574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:01.346401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49ab068b-bbaf-451e-86a2-bb07d21316ae tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1690 microversion: 2.1 time: 0.199617 Sep 28 07:30:01.347031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 312/609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:01 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:02.368597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:02.369235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:02.376384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:02.376864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:02.377322 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:02.378014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:02.378465 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:02.378883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:02.521956 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:02.530902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-66756868-fc1f-45bf-aa1d-5f5ca6498585 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1690 microversion: 2.1 time: 0.165554 Sep 28 07:30:02.531558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 298/610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:02 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:03.555320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:03.556111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:03.564246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:03.564783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:03.565266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:03.565978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:03.566591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:03.567021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:03.709014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:03.716764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5ceb68eb-c8c9-43a7-9eb1-02e7fed43fc9 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1690 microversion: 2.1 time: 0.165411 Sep 28 07:30:03.717398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 313/611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:03 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:04.740101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:04.740712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:04.747125 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:04.747607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:04.748042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:04.749458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:04.749986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:04.750519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:04.962196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:04.971985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4982c2de-c33a-42d1-9989-6fada62ffc5f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1690 microversion: 2.1 time: 0.235704 Sep 28 07:30:04.972880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 299/612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:04 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1690 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:05.749886 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-57502bfd-b8a3-4cf6-9fbf-a1a6b313bda4 req-3e11489e-b22a-4ebd-8004-8e2615b319ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268a5985-193b-4474-81f1-3140ec176c98", "name": "network-vif-deleted", "tag": "8f48e4d9-3822-4acd-8b65-44198c2add90"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:05.766320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-57502bfd-b8a3-4cf6-9fbf-a1a6b313bda4 req-3e11489e-b22a-4ebd-8004-8e2615b319ac service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:05.767276 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-57502bfd-b8a3-4cf6-9fbf-a1a6b313bda4 req-3e11489e-b22a-4ebd-8004-8e2615b319ac service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:05.767809 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-57502bfd-b8a3-4cf6-9fbf-a1a6b313bda4 req-3e11489e-b22a-4ebd-8004-8e2615b319ac service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:05.802680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-57502bfd-b8a3-4cf6-9fbf-a1a6b313bda4 req-3e11489e-b22a-4ebd-8004-8e2615b319ac service nova] Creating event network-vif-deleted:8f48e4d9-3822-4acd-8b65-44198c2add90 for instance 268a5985-193b-4474-81f1-3140ec176c98 on hv-cinder-85944 Sep 28 07:30:05.809719 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-57502bfd-b8a3-4cf6-9fbf-a1a6b313bda4 req-3e11489e-b22a-4ebd-8004-8e2615b319ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143011 Sep 28 07:30:05.810325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 314/613] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:05.995509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:05.996145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:06.003312 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:06.004477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:06.004820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:06.005670 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:06.006259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:06.006791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:06.042820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:06.043267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:06.043884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:06.044485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'fault' on Instance uuid 268a5985-193b-4474-81f1-3140ec176c98 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:30:06.099982 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:06.108368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-21bd1987-3ea9-4bad-a841-4b9cfae00e97 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 200 len: 1336 microversion: 2.1 time: 0.116106 Sep 28 07:30:06.108936 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 300/614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:05 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:07.139750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:07.140352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 268a5985-193b-4474-81f1-3140ec176c98] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:07.146887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:07.147362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:07.147784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:07.148457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:07.148908 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:07.149350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:07.162175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] HTTP exception thrown: Instance 268a5985-193b-4474-81f1-3140ec176c98 could not be found. Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Request method failure captured: Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 HTTP/1.1 Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aedx0GaOLcT8p38w3Cu7oXV8RXsgepU8W30147Vp_LPN9AKSfFIcayr_DcvqSz5UZviIa-kgfyPfCBolaMQZR11x4crY6KUXnKu86HSGx-ulIR389kAdPlOGWLdzRYr3RjfPpSdk4XmdubfYOM0MFPz7yV3FFLIOIMpclNMGA0Mhg Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:30:07.163738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc7675d275394d8893d0facf20d3a4e7", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: d286b1e0afe9413291e0e2503b4c204a Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 268a5985-193b-4474-81f1-3140ec176c98 could not be found. Sep 28 07:30:07.165436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '268a5985-193b-4474-81f1-3140ec176c98'} Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268a5985-193b-4474-81f1-3140ec176c98 could not be found. Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:30:07.166345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268a5985-193b-4474-81f1-3140ec176c98 could not be found. Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268a5985-193b-4474-81f1-3140ec176c98 could not be found. Sep 28 07:30:07.167887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:07.169207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Returning 404 to user: Instance 268a5985-193b-4474-81f1-3140ec176c98 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:30:07.169207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36bb6609-862c-40b2-a28d-b1f1ddd3d229 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98" status: 404 len: 111 microversion: 2.1 time: 0.029617 Sep 28 07:30:07.169207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 315/615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:07 2022] GET /compute/v2.1/servers/268a5985-193b-4474-81f1-3140ec176c98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:30:07.174513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7bdf0ee6-cc48-4a9e-b2aa-2fe2f509dc22 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '.version_select at 0x7fa861e92dc0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:07.196769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7bdf0ee6-cc48-4a9e-b2aa-2fe2f509dc22 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265036667" status: 202 len: 0 microversion: 2.1 time: 0.026603 Sep 28 07:30:07.197376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 301/616] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 07:30:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265036667 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:30:09.495299 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:09.497922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:09.505756 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:09.506243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:09.506675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:09.507445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:09.507902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:09.508367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:09.542262 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-125cb8d0-e096-46d0-b8f3-19dbb6f6e13c tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051239 Sep 28 07:30:09.542880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 316/617] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:30:09 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:30:09.611709 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:09.613389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:09.620028 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:09.620652 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:09.621239 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:09.622133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:09.622813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:09.623233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:09.650077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:30:09.738689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8734d3bf-a490-48ba-8795-9e59020d6868 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 204 len: 0 microversion: 2.1 time: 0.131924 Sep 28 07:30:09.739602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 302/618] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:30:09 2022] DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:30:09.748049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:09.748621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:09.754781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:09.755261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:09.755693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:09.756382 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:09.756835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:09.757454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:09.905828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:09.914345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1270e3bc-7278-4bda-8c2f-511ea048aff9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1671 microversion: 2.1 time: 0.169970 Sep 28 07:30:09.914930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 317/619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:09 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:10.318375 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:10.318985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:10.324915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:10.325442 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:10.325875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:10.326594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:10.327083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:10.327628 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:10.356536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:30:10.434070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f7d5a75c-be34-411d-98b3-bb34e238ff99 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 204 len: 0 microversion: 2.1 time: 0.119659 Sep 28 07:30:10.434897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 303/620] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:30:10 2022] DELETE /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:30:10.442779 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:10.443386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:10.445328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:10.450978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:10.451486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:10.451924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:10.452607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:10.453108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:10.453532 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:10.583816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:10.591650 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e4bf114c-9a77-4aa9-b9e6-41c0398ef26f tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1508 microversion: 2.1 time: 0.152635 Sep 28 07:30:10.592780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 318/621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:10 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:10.939137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:10.939834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:10.946544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:10.947013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:10.947445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:10.948185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:10.948642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:10.949243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:11.084077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:11.092173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-49ad921c-75ce-48ac-a492-11920e5a1225 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1671 microversion: 2.1 time: 0.158043 Sep 28 07:30:11.092857 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 304/622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:10 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:11.614646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:11.615252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:11.621664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:11.622142 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:11.622576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:11.623251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:11.624430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:11.625160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:11.759290 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:11.766970 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9e3c3536-1cc3-41dd-8072-aa3a3a1d3c8a tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1508 microversion: 2.1 time: 0.156195 Sep 28 07:30:11.767606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 319/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:11 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:12.115536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:12.116226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:12.122562 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:12.123040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:12.123523 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:12.124276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:12.124715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:12.125152 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:12.143819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:12.263293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:12.271793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-22ac22f9-fd46-4a89-8382-5fc22db5be14 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1671 microversion: 2.1 time: 0.159981 Sep 28 07:30:12.272358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 305/624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:12 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:12.791004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:12.791599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:12.797993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:12.798470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:12.798897 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:12.799572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:12.800014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:12.800427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:12.937146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:12.944960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fbd49468-b7bd-4d67-8819-63f130b04e72 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1508 microversion: 2.1 time: 0.157731 Sep 28 07:30:12.945869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 320/625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:12 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:13.296051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:13.296794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:13.303196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:13.303681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:13.304110 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:13.304801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:13.305278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:13.305704 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:13.401760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:13.412066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3c23d194-418b-4899-884b-13a412b1bea1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1605 microversion: 2.1 time: 0.119925 Sep 28 07:30:13.412648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 306/626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:13 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1605 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:13.864444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d88d1628-d783-4fea-b3b2-55c4192a2b75 req-9fe142e8-a883-4f37-bd4c-3b1db1059ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e3e956-5f6c-45a6-856b-cea495f8a0c8", "name": "network-vif-deleted", "tag": "2fcc55c9-f8c5-4280-ac79-26e52989b39d"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:13.887011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d88d1628-d783-4fea-b3b2-55c4192a2b75 req-9fe142e8-a883-4f37-bd4c-3b1db1059ea5 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:13.887935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d88d1628-d783-4fea-b3b2-55c4192a2b75 req-9fe142e8-a883-4f37-bd4c-3b1db1059ea5 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:13.889505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d88d1628-d783-4fea-b3b2-55c4192a2b75 req-9fe142e8-a883-4f37-bd4c-3b1db1059ea5 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:13.915208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d88d1628-d783-4fea-b3b2-55c4192a2b75 req-9fe142e8-a883-4f37-bd4c-3b1db1059ea5 service nova] Creating event network-vif-deleted:2fcc55c9-f8c5-4280-ac79-26e52989b39d for instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 on hv-cinder-85944 Sep 28 07:30:13.930264 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d88d1628-d783-4fea-b3b2-55c4192a2b75 req-9fe142e8-a883-4f37-bd4c-3b1db1059ea5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072023 Sep 28 07:30:13.931129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 321/627] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:13.972481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:13.973485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:13.986208 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:13.986949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:13.987569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:13.988438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:13.989076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:13.989703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:14.049667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:14.050402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:14.050987 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:14.062226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'fault' on Instance uuid 48e3e956-5f6c-45a6-856b-cea495f8a0c8 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:30:14.121092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:14.135066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bb387f19-f6c6-4969-bba7-b5a0ae1557e1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 200 len: 1312 microversion: 2.1 time: 0.167039 Sep 28 07:30:14.137345 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 307/628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:13 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:14.437435 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:14.438524 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:14.444603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:14.445115 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:14.445543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:14.446227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:14.446701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:14.447116 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:14.478491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:14.478962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:14.479383 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:14.479810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lazy-loading 'fault' on Instance uuid 475e52e8-57f8-4c53-b01d-52e19d35a1af {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:30:14.520393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:14.530580 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83c6e31e-67cb-4890-b244-5d2005932b67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 200 len: 1327 microversion: 2.1 time: 0.098173 Sep 28 07:30:14.531352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 322/629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:14 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:15.159779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:15.160422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: 48e3e956-5f6c-45a6-856b-cea495f8a0c8] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:15.166875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.167353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.167791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.168478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.168931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.169380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.183025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] HTTP exception thrown: Instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 could not be found. Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Request method failure captured: Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 HTTP/1.1 Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aedx0GaOLcT8p38w3Cu7oXV8RXsgepU8W30147Vp_LPN9AKSfFIcayr_DcvqSz5UZviIa-kgfyPfCBolaMQZR11x4crY6KUXnKu86HSGx-ulIR389kAdPlOGWLdzRYr3RjfPpSdk4XmdubfYOM0MFPz7yV3FFLIOIMpclNMGA0Mhg Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:30:15.184899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc7675d275394d8893d0facf20d3a4e7", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: d286b1e0afe9413291e0e2503b4c204a Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 could not be found. Sep 28 07:30:15.186989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '48e3e956-5f6c-45a6-856b-cea495f8a0c8'} Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 could not be found. Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:30:15.187726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 could not be found. Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 could not be found. Sep 28 07:30:15.188853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.190001 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Returning 404 to user: Instance 48e3e956-5f6c-45a6-856b-cea495f8a0c8 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:30:15.190001 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-53a12754-53ad-4b9c-9288-918490a8505b tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8" status: 404 len: 111 microversion: 2.1 time: 0.031114 Sep 28 07:30:15.190001 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 308/630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:15 2022] GET /compute/v2.1/servers/48e3e956-5f6c-45a6-856b-cea495f8a0c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:30:15.198549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:15.199037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:15.208910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.209689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.210321 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.210807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.211273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.211694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.238333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:30:15.328601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-36b9dcd2-1557-47aa-9e2a-70c81ec5a8f1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 204 len: 0 microversion: 2.1 time: 0.133605 Sep 28 07:30:15.329974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 323/631] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:30:15 2022] DELETE /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:30:15.340147 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:15.341055 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:15.349894 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.351341 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.351995 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.352701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.353832 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.354310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.496742 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:15.504565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b8764ab7-8ef5-4d51-a2c6-8c5530e4bdc1 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.170242 Sep 28 07:30:15.505167 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 309/632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:15 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:15.554646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:15.555343 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:15.561658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.562134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.562563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.563234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.563678 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.564098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.577158 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] HTTP exception thrown: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Request method failure captured: Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af HTTP/1.1 Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aZyXStU7d_Yo37b9yIrPz9UPHSK_DaRg_O3-U3kaSVEede7e0YlQMD51OQlIKLxJbEo9fMn_6UkSuIkTnq44wAgGAIV7WWTjzon8lunl8QVXvmU2Qavyk31kv9Wllt9VlnvAPd9vmAiPjdfh9ZphIUURU4tOrGj6AOrQYwtB00pdg Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:30:15.578715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f391a1187074b68b3c6a887634b479b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 269ef35368734dcd9d3cc901db39fe10 Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:30:15.580205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '475e52e8-57f8-4c53-b01d-52e19d35a1af'} Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:30:15.581009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:30:15.582178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:15.583246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Returning 404 to user: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:30:15.583246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e708d56-a83a-46e2-af9f-c02d273f1c39 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 404 len: 111 microversion: 2.1 time: 0.030379 Sep 28 07:30:15.583246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 324/633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:15 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:30:15.591121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-76982de3-70e3-4435-8790-a47216ab4bc6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '.version_select at 0x7fa861db69d0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:15.610787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-76982de3-70e3-4435-8790-a47216ab4bc6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759020567" status: 202 len: 0 microversion: 2.1 time: 0.023379 Sep 28 07:30:15.611333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 310/634] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 07:30:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759020567 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:30:15.957810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-de44c150-f9dc-4d6c-b332-779949436297 req-612548ba-c184-43f7-bcb5-b95ec2d8b454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475e52e8-57f8-4c53-b01d-52e19d35a1af", "name": "network-vif-deleted", "tag": "b2a7b488-544e-4fa3-9375-a53ff209f778"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:15.967310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-de44c150-f9dc-4d6c-b332-779949436297 req-612548ba-c184-43f7-bcb5-b95ec2d8b454 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:15.967782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-de44c150-f9dc-4d6c-b332-779949436297 req-612548ba-c184-43f7-bcb5-b95ec2d8b454 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:15.968209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-de44c150-f9dc-4d6c-b332-779949436297 req-612548ba-c184-43f7-bcb5-b95ec2d8b454 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:15.979513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-de44c150-f9dc-4d6c-b332-779949436297 req-612548ba-c184-43f7-bcb5-b95ec2d8b454 service nova] Creating event network-vif-deleted:b2a7b488-544e-4fa3-9375-a53ff209f778 for instance 475e52e8-57f8-4c53-b01d-52e19d35a1af on hv-cinder-85944 Sep 28 07:30:15.985707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-de44c150-f9dc-4d6c-b332-779949436297 req-612548ba-c184-43f7-bcb5-b95ec2d8b454 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Sep 28 07:30:15.986565 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 325/635] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:16.274089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6691ecd1-90b9-4f91-add3-1b6542ecb0c5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: .version_select at 0x7fa861d72040>, body: {"keypair": {"name": "tempest-keypair-1893037167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrS/LBXEIZ9ZDA3VWUADfPq8URyJ44/qSk8z7LA0eCOMnlZ9/tkeqSckCdI6CXY8/AZPPNf+f8pYmYTY5fXIxBDrDBJo/mquWiZufmed21CBDbP875vL5P0jBblQPCd+g=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:16.294329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-6691ecd1-90b9-4f91-add3-1b6542ecb0c5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for project 6f391a1187074b68b3c6a887634b479b. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:30:16.298174 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-6691ecd1-90b9-4f91-add3-1b6542ecb0c5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for user 269ef35368734dcd9d3cc901db39fe10 and project 6f391a1187074b68b3c6a887634b479b. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:30:16.320641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6691ecd1-90b9-4f91-add3-1b6542ecb0c5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051907 Sep 28 07:30:16.321300 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 311/636] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:30:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:16.530229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:16.531164 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:16.538902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:16.539612 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:16.540053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:16.540785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:16.541299 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:16.542082 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:16.729174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:16.738350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-686e3d26-dfde-4dd2-86e1-34eafcabb12e tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.214438 Sep 28 07:30:16.739161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 326/637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:16 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:17.078085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:17.078706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:17.085422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:17.085927 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:17.086383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:17.087071 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:17.087548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:17.087964 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:17.116206 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fc0151d1-37d3-4303-ad6e-edb44f65eb7e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/ips" status: 200 len: 151 microversion: 2.20 time: 0.042060 Sep 28 07:30:17.116773 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 312/638] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Sep 28 07:30:17 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:30:17.564255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1940773705", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a68568d7-53b7-4646-8455-51184edc4b5d"}], "security_groups": [{"name": "tempest-securitygroup--1413886680"}], "key_name": "tempest-keypair-1893037167", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:17.667789 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] validate_networks() for [('a68568d7-53b7-4646-8455-51184edc4b5d', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:30:17.761378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:17.762000 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:17.768327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:17.768806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:17.769265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:17.769949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:17.770399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:17.770815 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:17.914145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:17.922289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-78664de9-cdfb-4f8a-8784-32d972a58699 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.164803 Sep 28 07:30:17.922849 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 313/639] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:17 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:18.136074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:30:18.136491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:30:18.137033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:30:18.137442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:30:18.137853 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:30:18.146868 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:18.147349 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:18.147780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:18.148496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:18.148962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:18.149392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:18.165954 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for project 6f391a1187074b68b3c6a887634b479b. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:30:18.169847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Getting quotas for user 269ef35368734dcd9d3cc901db39fe10 and project 6f391a1187074b68b3c6a887634b479b. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:30:18.181166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:30:18.183430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:30:18.230629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1655493e-88fd-4a7f-889d-88e3b34c117a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.670855 Sep 28 07:30:18.231196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 327/640] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:30:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:30:18.243160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c80afaa6-801d-45a3-a02f-c143e0cf6a0a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:18.243783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c80afaa6-801d-45a3-a02f-c143e0cf6a0a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:18.301632 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c80afaa6-801d-45a3-a02f-c143e0cf6a0a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:18.308798 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c80afaa6-801d-45a3-a02f-c143e0cf6a0a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1238 microversion: 2.1 time: 0.069584 Sep 28 07:30:18.309654 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 314/641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:18 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:18.946446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:18.947049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:18.955367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:18.956160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:18.956910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:18.957857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:18.958511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:18.959135 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.111095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:19.119113 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a8539aa-aa72-4486-8a89-eb884a779711 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1521 microversion: 2.1 time: 0.177095 Sep 28 07:30:19.119693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 328/642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:18 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:19.265196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-b6e59b27-acb3-4702-9387-c42ef9941c68 req-a14cc4b6-472f-41ef-90a8-d81229fc5fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3780a43-5882-4fed-90eb-bd39060f6d99", "name": "network-vif-deleted", "tag": "648be1a4-0bc1-44aa-a1c5-4643d67519e4"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:19.275640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-b6e59b27-acb3-4702-9387-c42ef9941c68 req-a14cc4b6-472f-41ef-90a8-d81229fc5fba service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.276120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-b6e59b27-acb3-4702-9387-c42ef9941c68 req-a14cc4b6-472f-41ef-90a8-d81229fc5fba service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.276551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-b6e59b27-acb3-4702-9387-c42ef9941c68 req-a14cc4b6-472f-41ef-90a8-d81229fc5fba service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.287715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-b6e59b27-acb3-4702-9387-c42ef9941c68 req-a14cc4b6-472f-41ef-90a8-d81229fc5fba service nova] Creating event network-vif-deleted:648be1a4-0bc1-44aa-a1c5-4643d67519e4 for instance d3780a43-5882-4fed-90eb-bd39060f6d99 on hv-cinder-85944 Sep 28 07:30:19.292523 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-b6e59b27-acb3-4702-9387-c42ef9941c68 req-a14cc4b6-472f-41ef-90a8-d81229fc5fba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Sep 28 07:30:19.293147 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 315/643] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:19.332411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:19.333047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:19.338916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.339403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.339837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.340520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.340992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.341415 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.360233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:19.410467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:19.418187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-96dc76b7-6363-44ee-8d8b-65f8774f8380 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1290 microversion: 2.1 time: 0.089659 Sep 28 07:30:19.418749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 329/644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:19 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:19.616670 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:19.617946 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:19.631896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.632641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.633274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.634706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.635429 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.637075 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.693655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lazy-loading 'flavor' on Instance uuid dbc79aa8-ba8d-4d91-be11-1866bb283ca5 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:30:19.953822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-aa89ece3-41da-4792-b6bd-190ba235d2b7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/action" status: 202 len: 0 microversion: 2.20 time: 0.343946 Sep 28 07:30:19.954635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 316/645] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 07:30:19 2022] POST /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:30:19.963992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:19.965098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:19.972086 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.972578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.973040 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:19.973744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:19.974202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:19.974625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:20.108145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:20.117431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:20.118875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:20.120038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e498d2ae-ebbd-4815-b622-61dd5ebe9052 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.160889 Sep 28 07:30:20.120606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 330/646] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:19 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:20.143075 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:20.143782 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:20.150194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:20.150685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:20.151151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:20.151847 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:20.152304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:20.152727 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:20.185310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:20.185876 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:20.186369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:20.186838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lazy-loading 'fault' on Instance uuid d3780a43-5882-4fed-90eb-bd39060f6d99 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:30:20.244939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd286b1e0afe9413291e0e2503b4c204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7675d275394d8893d0facf20d3a4e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:20.256579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ad961c45-ed8e-4fce-ab16-3a1dbe772e52 tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 200 len: 1312 microversion: 2.1 time: 0.117923 Sep 28 07:30:20.257279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 317/647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:20 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:20.442819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:20.443935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:20.450957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:20.451998 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:20.452509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:20.453647 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:20.456176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:20.456869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:20.605474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:20.613352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-18eff1a2-ea61-49d2-9af5-8032b06e0abd tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.175536 Sep 28 07:30:20.613952 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 331/648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:20 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:20.807078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-551733074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1817965910", "security_groups": [{"name": "tempest-secgroup-smoke-401944427"}], "block_device_mapping_v2": [{"uuid": "7d8395d5-6523-4c3d-8461-cedcab9dea0e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3597cb55-79da-4b37-872b-aa28123264c5"}]}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:21.147416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:21.148079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:21.154667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.155564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.156114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.156911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.157486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.157978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.222386 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] validate_networks() for [('3597cb55-79da-4b37-872b-aa28123264c5', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:30:21.291017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:21.300081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:21.301538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:21.302692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bdeea7d1-8839-445c-9930-629809382ac2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.159320 Sep 28 07:30:21.303256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 332/649] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:21 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:30:21.311960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:21.311960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] [instance: d3780a43-5882-4fed-90eb-bd39060f6d99] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:21.316598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.317299 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.318326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.318450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.318879 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.319627 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.336763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] HTTP exception thrown: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 could not be found. Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Request method failure captured: Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 HTTP/1.1 Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aedx0GaOLcT8p38w3Cu7oXV8RXsgepU8W30147Vp_LPN9AKSfFIcayr_DcvqSz5UZviIa-kgfyPfCBolaMQZR11x4crY6KUXnKu86HSGx-ulIR389kAdPlOGWLdzRYr3RjfPpSdk4XmdubfYOM0MFPz7yV3FFLIOIMpclNMGA0Mhg Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:30:21.339002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fc7675d275394d8893d0facf20d3a4e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fc7675d275394d8893d0facf20d3a4e7", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fc7675d275394d8893d0facf20d3a4e7 Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1575633544 Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: d286b1e0afe9413291e0e2503b4c204a Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1575633544-project Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 could not be found. Sep 28 07:30:21.340550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'd3780a43-5882-4fed-90eb-bd39060f6d99'} Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 could not be found. Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:30:21.341469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 could not be found. Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 could not be found. Sep 28 07:30:21.343247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:30:21.344371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] Returning 404 to user: Instance d3780a43-5882-4fed-90eb-bd39060f6d99 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:30:21.344371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1b4256e-ca92-4706-94a0-091fa9b28c6d tempest-ServerRescueNegativeTestJSON-1575633544 tempest-ServerRescueNegativeTestJSON-1575633544-project] 10.222.0.52 "GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99" status: 404 len: 111 microversion: 2.1 time: 0.035803 Sep 28 07:30:21.344371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 333/650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:21 2022] GET /compute/v2.1/servers/d3780a43-5882-4fed-90eb-bd39060f6d99 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:30:21.558917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-122f11e3-c6aa-4ede-9b56-ffd2619e379b req-40429be4-a95f-4e1a-ad8c-b32882d40163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db94c92-043c-4834-903c-2a192fe45d02", "tag": "ee66bf46-3d63-4bf1-879b-6e217b8ac1d2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:21.572442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-122f11e3-c6aa-4ede-9b56-ffd2619e379b req-40429be4-a95f-4e1a-ad8c-b32882d40163 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.575228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-122f11e3-c6aa-4ede-9b56-ffd2619e379b req-40429be4-a95f-4e1a-ad8c-b32882d40163 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.577686 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-122f11e3-c6aa-4ede-9b56-ffd2619e379b req-40429be4-a95f-4e1a-ad8c-b32882d40163 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.593857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-122f11e3-c6aa-4ede-9b56-ffd2619e379b req-40429be4-a95f-4e1a-ad8c-b32882d40163 service nova] Creating event network-changed:ee66bf46-3d63-4bf1-879b-6e217b8ac1d2 for instance 1db94c92-043c-4834-903c-2a192fe45d02 on hv-cinder-85944 Sep 28 07:30:21.599290 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-122f11e3-c6aa-4ede-9b56-ffd2619e379b req-40429be4-a95f-4e1a-ad8c-b32882d40163 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044311 Sep 28 07:30:21.600590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 334/651] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:21.637070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:21.637771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:21.646891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.647386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.647820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.648903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.649842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.650280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.953357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:30:21.953886 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:30:21.954531 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:30:21.955056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:30:21.955633 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:30:21.964850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.965824 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.966732 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.968276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:21.969106 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:21.969739 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:21.987585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:30:21.991997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for user 04cf365443b44d9d87338d95b5b0251b and project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:30:21.994596 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:22.058196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:30:22.060768 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d8395d5-6523-4c3d-8461-cedcab9dea0e',volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:30:22.081112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:22.088839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d4790360-1683-46ee-b9e9-9e02a00fd785 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.455996 Sep 28 07:30:22.089510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 335/652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:21 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:22.218081 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-97a0a93e-cb2a-45c0-a825-a5524719473a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.414760 Sep 28 07:30:22.218760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 318/653] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:30:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:30:22.230905 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59d96135-aab9-4217-9fac-0047f03b636e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:22.232175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59d96135-aab9-4217-9fac-0047f03b636e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:22.332703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:22.333459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:22.334579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-59d96135-aab9-4217-9fac-0047f03b636e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:22.340278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:22.340834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:22.341363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:22.341607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-59d96135-aab9-4217-9fac-0047f03b636e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1094 microversion: 2.1 time: 0.115133 Sep 28 07:30:22.342715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:22.343280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:22.344046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:22.353422 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 336/654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:22 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1094 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:22.503885 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:22.512579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:22.514233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:22.515415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-26651c41-c106-4599-89da-3b31d2225b69 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.189570 Sep 28 07:30:22.515973 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 319/655] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:22 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:30:23.112563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:23.113209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:23.119102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:23.119585 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:23.120026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:23.120713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:23.121190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:23.121616 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:23.363449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:23.369248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:23.372476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:23.385715 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:23.386271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:23.386700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:23.388641 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-78da3709-1ace-44b4-b3c1-a8aad6d9026a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.279831 Sep 28 07:30:23.389876 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 337/656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:23 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:23.390833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:23.391463 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:23.392027 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:23.515888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:23.526539 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7f5401d0-489f-4186-9d6d-594f28918b3b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1192 microversion: 2.1 time: 0.161061 Sep 28 07:30:23.531201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 320/657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:23 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1192 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:23.541199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:23.542570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:23.550168 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:23.551315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:23.552019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:23.553397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:23.554053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:23.554817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:23.765883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:23.774563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:23.776123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:23.777539 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d155ab13-a55c-40ee-895a-732aa4b70126 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.240180 Sep 28 07:30:23.778501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 338/658] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:23 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:24.413488 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:24.414483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:24.424555 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:24.425244 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:24.425797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:24.426658 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:24.427156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:24.427667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:24.557397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:24.557970 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:24.568594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:24.569774 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:24.570720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:24.571692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:24.572520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:24.574964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:24.697413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:24.707562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a2886731-d76b-4f0f-ae89-008357a099c1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1210 microversion: 2.1 time: 0.155799 Sep 28 07:30:24.708157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 339/659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:24 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:24.803629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:24.804229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:24.810400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:24.811646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:24.812243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:24.813138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:24.813746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:24.814315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:24.841439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:24.849827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e2dd71c5-a447-4f37-a6b0-d8fd77cea4d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.440930 Sep 28 07:30:24.851082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 321/660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:24 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:24.996917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:25.007118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:25.008699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:25.009913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34cab251-6980-4fad-ae75-0433ec19aeaa tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.210241 Sep 28 07:30:25.010795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 340/661] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:24 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:25.732412 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:25.734705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:25.742694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:25.743216 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:25.743669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:25.744512 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:25.745051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:25.745481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:25.880881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:25.882718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:25.887255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:25.893432 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:25.894248 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:25.894990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:25.897201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:25.897938 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:25.899514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:26.003663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:26.014615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f779dc19-353c-4eb6-b6ca-9877f1e344d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.286790 Sep 28 07:30:26.019725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 322/662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:25 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:26.051597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:26.052276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:26.064553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:26.065357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:26.065799 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:26.066506 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:26.066963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:26.067384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:26.168096 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:26.176603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fb2ae063-822a-46d4-812c-7bc10eeabe37 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.301240 Sep 28 07:30:26.177208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 341/663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:25 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:26.309806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:26.326798 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:26.329084 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:26.330446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f8368992-5a3e-4824-a06b-8f08dfcb4ca0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.294157 Sep 28 07:30:26.331299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 323/664] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:26 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:26.369356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-6e833943-65a3-46f4-aaa1-45e65a30f0ea req-3a228782-597b-46d7-8a68-1b97693f2f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e62a15-55d5-43ca-a578-13300d349c53", "tag": "c820c0dd-b904-418b-a64a-a70ba69e8c04"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:26.385484 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6e833943-65a3-46f4-aaa1-45e65a30f0ea req-3a228782-597b-46d7-8a68-1b97693f2f7e service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:26.386397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6e833943-65a3-46f4-aaa1-45e65a30f0ea req-3a228782-597b-46d7-8a68-1b97693f2f7e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:26.387108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6e833943-65a3-46f4-aaa1-45e65a30f0ea req-3a228782-597b-46d7-8a68-1b97693f2f7e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:26.408821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-6e833943-65a3-46f4-aaa1-45e65a30f0ea req-3a228782-597b-46d7-8a68-1b97693f2f7e service nova] Creating event network-changed:c820c0dd-b904-418b-a64a-a70ba69e8c04 for instance a4e62a15-55d5-43ca-a578-13300d349c53 on hv-cinder-85944 Sep 28 07:30:26.415684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-6e833943-65a3-46f4-aaa1-45e65a30f0ea req-3a228782-597b-46d7-8a68-1b97693f2f7e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050210 Sep 28 07:30:26.416700 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 342/665] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:27.044727 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:27.045563 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:27.051928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:27.052418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:27.052854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:27.053576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:27.054033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:27.054457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:27.200880 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:27.201889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:27.208360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:27.208849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:27.209307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:27.210008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:27.210462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:27.210881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:27.348558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:27.357027 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-14c4c439-96b6-4e8c-a297-e12bbe447dc3 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.160795 Sep 28 07:30:27.357689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 343/666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:27 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:27.362625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:27.363230 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:27.369295 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:27.369782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:27.370217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:27.370903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:27.371355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:27.371771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:27.517516 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:27.525649 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:27.527095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:27.528247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7363fea6-ce47-432d-935e-956ef8f06980 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.169337 Sep 28 07:30:27.528803 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 344/667] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:27 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:27.624521 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:27.627967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:27.633598 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a54aa175-c9e2-44b9-8997-3912196c3ff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.593188 Sep 28 07:30:27.634817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 324/668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:27 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:28.157838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:28.176767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-e8e582fb-83dd-4392-9fc9-bcd8eea0ec5e req-b38f1921-1756-4693-b266-47a2fb5abb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db94c92-043c-4834-903c-2a192fe45d02", "name": "network-vif-plugged", "status": "completed", "tag": "ee66bf46-3d63-4bf1-879b-6e217b8ac1d2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:28.189022 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e8e582fb-83dd-4392-9fc9-bcd8eea0ec5e req-b38f1921-1756-4693-b266-47a2fb5abb79 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.189652 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e8e582fb-83dd-4392-9fc9-bcd8eea0ec5e req-b38f1921-1756-4693-b266-47a2fb5abb79 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.190317 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-e8e582fb-83dd-4392-9fc9-bcd8eea0ec5e req-b38f1921-1756-4693-b266-47a2fb5abb79 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.204223 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-e8e582fb-83dd-4392-9fc9-bcd8eea0ec5e req-b38f1921-1756-4693-b266-47a2fb5abb79 service nova] Creating event network-vif-plugged:ee66bf46-3d63-4bf1-879b-6e217b8ac1d2 for instance 1db94c92-043c-4834-903c-2a192fe45d02 on hv-cinder-85944 Sep 28 07:30:28.209327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-e8e582fb-83dd-4392-9fc9-bcd8eea0ec5e req-b38f1921-1756-4693-b266-47a2fb5abb79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209868 Sep 28 07:30:28.209950 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 345/669] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:28.383029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:28.383861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:28.392998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.393938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.395039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.395948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.396401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.397176 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.555003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:28.556273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:28.564431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.565205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.565868 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.566798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.567477 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.568105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.599346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:28.609190 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8a80cd01-bdc4-4cc2-913f-4d4a1f9f348f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.231167 Sep 28 07:30:28.610392 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 325/670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:28 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:28.658787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:28.659402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:28.669470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.671254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.671879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.672588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:28.673377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:28.673803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:28.815185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:28.839192 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:28.841863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:28.846420 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6f2d5d8-ec25-48d3-a04d-936fa25a1998 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.296599 Sep 28 07:30:28.847011 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 346/671] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:28 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:30:28.867555 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:28.877748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0d1736ea-11df-4aa0-9d03-3f4f1c9999c9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.222905 Sep 28 07:30:28.878740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 326/672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:28 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:29.633750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:29.634358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:29.642199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:29.642689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:29.643128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:29.643856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:29.644479 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:29.644902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:29.819639 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:29.834804 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b1930e05-2584-4e2f-90a5-43a839e4b332 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1364 microversion: 2.1 time: 0.204806 Sep 28 07:30:29.836869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 347/673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:29 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:29.877039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:29.878792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:29.891351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:29.895012 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:29.896983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:29.898067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:29.898872 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:29.899490 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:29.902056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:29.903160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:29.921071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:29.923203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:29.923833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:29.925929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:29.926768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:29.927458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:30.089468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:30.098386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:30.103581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:30.105997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:30.109784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-da2715f1-0cb5-4231-b80a-878c3306371d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.236074 Sep 28 07:30:30.111121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 327/674] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:29 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:30.113723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efd2141b-f9d1-493e-bba7-18a4a524f4ba tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.209221 Sep 28 07:30:30.115036 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 348/675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:29 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:30.872377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:30.874657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:30.881835 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:30.883043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:30.883545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:30.884268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:30.884697 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:30.885144 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.148406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:31.151991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:31.178348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:31.179037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:31.179624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.181218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:31.181980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:31.182555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.242170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:31.267329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-49865ab3-e257-4010-8119-f0ceb6b92c67 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1550 microversion: 2.1 time: 0.404851 Sep 28 07:30:31.288833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 328/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:30 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1550 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:31.294524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:31.296697 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:31.304010 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:31.304724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:31.305511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.306397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:31.308251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:31.309917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.431265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:31.437118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:31.446859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:31.449521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:31.450905 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f549ee2-2bca-4186-96b1-dbd3b19ab026 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.308296 Sep 28 07:30:31.467274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 349/677] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:31 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:31.473450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:31.474379 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:31.489633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:31.490219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:31.490724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.491510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:31.492043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:31.492546 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:31.577510 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:31.594875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-84eed463-3e32-4cbb-a96b-52cd0fab1a1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.302579 Sep 28 07:30:31.596007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 329/678] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:31 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:31.611580 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb873085-f267-4825-84b0-2a4d71ba8e86 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145101 Sep 28 07:30:31.621057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 350/679] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:30:31 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:32.308570 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:32.310046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=12 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:32.387853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c364a78b-b7f7-4edf-a375-3c1a511993fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: .version_select at 0x7fa861de3ee0>, body: {"keypair": {"name": "tempest-keypair-2095849973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxxDicQBuD+tEIFSwcd3NiJVsxtrV/vAA4YsEwOd1SXsOf1ne+YBYcr9XshMUxWeM79ubgrLyahVpVUiufLg2kZavNjTKUXpfJJxo8IIn/mwZs80BULGTrX+ESs1dHRlA=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:32.412257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c364a78b-b7f7-4edf-a375-3c1a511993fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:30:32.418321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c364a78b-b7f7-4edf-a375-3c1a511993fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:30:32.452401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c364a78b-b7f7-4edf-a375-3c1a511993fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149698 Sep 28 07:30:32.453860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 330/680] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:30:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:32.481963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:32.483488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:32.494270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:32.508609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:32.516885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:32.518805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:32.519800 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:32.521656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:32.522697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:32.621604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:32.622244 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:32.635321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:32.635814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:32.638130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:32.640721 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:32.641454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:32.643170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:32.899583 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:32.909269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:32.910749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:32.911910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8bafd565-66e0-4efe-9850-220d311573bb tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.435217 Sep 28 07:30:32.917196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 351/681] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:32 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:33.005823 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:33.024252 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-643e1dbe-b3b5-41e9-a368-68b9c6aa3396 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.406622 Sep 28 07:30:33.024837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 331/682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:32 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:33.139531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-2b31d22c-273c-4a59-9a4b-ce8c5e8337df req-38650cb6-a0a0-4ad0-813f-7d9cefc39cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db94c92-043c-4834-903c-2a192fe45d02", "tag": "ee66bf46-3d63-4bf1-879b-6e217b8ac1d2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:33.152117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2b31d22c-273c-4a59-9a4b-ce8c5e8337df req-38650cb6-a0a0-4ad0-813f-7d9cefc39cdb service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:33.152924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2b31d22c-273c-4a59-9a4b-ce8c5e8337df req-38650cb6-a0a0-4ad0-813f-7d9cefc39cdb service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:33.154225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-2b31d22c-273c-4a59-9a4b-ce8c5e8337df req-38650cb6-a0a0-4ad0-813f-7d9cefc39cdb service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:33.170849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-2b31d22c-273c-4a59-9a4b-ce8c5e8337df req-38650cb6-a0a0-4ad0-813f-7d9cefc39cdb service nova] Creating event network-changed:ee66bf46-3d63-4bf1-879b-6e217b8ac1d2 for instance 1db94c92-043c-4834-903c-2a192fe45d02 on hv-cinder-85944 Sep 28 07:30:33.180003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-2b31d22c-273c-4a59-9a4b-ce8c5e8337df req-38650cb6-a0a0-4ad0-813f-7d9cefc39cdb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043631 Sep 28 07:30:33.185455 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 352/683] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:30:33.944399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:33.945137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:33.958041 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:33.959547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:33.960201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:33.961567 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:33.962729 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:33.964094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:34.052987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:34.055729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:34.071643 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:34.073250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:34.074784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:34.077451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:34.078337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:34.086513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:34.376744 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:34.394372 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:34.395884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:34.405647 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6be7bd38-00f3-4590-9656-01247cd5e7c6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.458612 Sep 28 07:30:34.409584 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 332/684] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:33 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:34.697074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:34.709494 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b6979e4-589a-4f28-bfab-6dca9845ddb0 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.662784 Sep 28 07:30:34.710186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 353/685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:34 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:35.126508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1231022677", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "733608a5-23eb-466d-8629-abe8aafc7bed"}], "security_groups": [{"name": "tempest-securitygroup--1957396006"}], "key_name": "tempest-keypair-2095849973", "user_data": "}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:35.259928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] validate_networks() for [('733608a5-23eb-466d-8629-abe8aafc7bed', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:30:35.440281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:35.440863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:35.448402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:35.448893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:35.449389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:35.450591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:35.451456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:35.452089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:35.631901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:35.643068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:35.644769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:35.646238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a20d455-b4f7-4e2c-a7da-e969b14e3376 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.213291 Sep 28 07:30:35.647760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 354/686] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:35 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:30:35.741394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:35.742108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:35.749849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:35.751245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:35.751842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:35.752737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:35.753629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:35.754231 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:35.961175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:35.969810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-04803537-5216-4274-9c4b-90f91fdd88b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.235648 Sep 28 07:30:35.971808 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 355/687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:35 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:36.069852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-8af6ca1b-fcef-4629-87bf-30494af294c9 req-fab2d7a2-778e-409c-b4ea-3cb4921dcffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e62a15-55d5-43ca-a578-13300d349c53", "name": "network-vif-plugged", "status": "completed", "tag": "c820c0dd-b904-418b-a64a-a70ba69e8c04"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:36.082785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:30:36.083638 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:30:36.084278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:30:36.085093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:30:36.085397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:30:36.096566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8af6ca1b-fcef-4629-87bf-30494af294c9 req-fab2d7a2-778e-409c-b4ea-3cb4921dcffb service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:36.099724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8af6ca1b-fcef-4629-87bf-30494af294c9 req-fab2d7a2-778e-409c-b4ea-3cb4921dcffb service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:36.100180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-8af6ca1b-fcef-4629-87bf-30494af294c9 req-fab2d7a2-778e-409c-b4ea-3cb4921dcffb service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:36.100603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:36.102285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:36.102902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:36.103797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:36.104398 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:36.105092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:36.121129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-8af6ca1b-fcef-4629-87bf-30494af294c9 req-fab2d7a2-778e-409c-b4ea-3cb4921dcffb service nova] Creating event network-vif-plugged:c820c0dd-b904-418b-a64a-a70ba69e8c04 for instance a4e62a15-55d5-43ca-a578-13300d349c53 on hv-cinder-85944 Sep 28 07:30:36.128393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-8af6ca1b-fcef-4629-87bf-30494af294c9 req-fab2d7a2-778e-409c-b4ea-3cb4921dcffb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062354 Sep 28 07:30:36.129087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 356/688] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:30:36.135581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:30:36.143335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:30:36.159072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:30:36.162076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:30:36.237918 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ea885f57-efe3-4d13-80a5-7f36ea47113c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.116932 Sep 28 07:30:36.238579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 333/689] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:30:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:30:36.256980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b90fc6aa-496b-4e79-a551-95a4a90381ca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:36.256980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b90fc6aa-496b-4e79-a551-95a4a90381ca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:36.432218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b90fc6aa-496b-4e79-a551-95a4a90381ca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:36.443132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b90fc6aa-496b-4e79-a551-95a4a90381ca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1242 microversion: 2.1 time: 0.197002 Sep 28 07:30:36.444206 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 357/690] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:36 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:36.677036 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:36.678515 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:36.711157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:36.711896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:36.715520 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:36.717455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:36.718188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:36.718767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:36.984333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:36.997562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:37.003790 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:37.005065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:37.005470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:37.006693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b353fb79-570e-4630-8cf3-9c592670c9d7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.337339 Sep 28 07:30:37.023405 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:37.024584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:37.025267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:37.026280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:37.027791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:37.028931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:37.029487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 334/691] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:36 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:37.228032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:37.240353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3a3a0285-a69f-4c86-9108-ce9e6410a4b2 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.247007 Sep 28 07:30:37.241205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 358/692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:36 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:37.468340 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:37.468996 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:37.478485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:37.479875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:37.480442 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:37.481298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:37.481919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:37.482992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:37.551510 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:37.559492 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9d1696b4-367b-4b85-a9a9-3bb8f1a28e14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1238 microversion: 2.1 time: 0.095689 Sep 28 07:30:37.560318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 335/693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:37 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:38.036292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:38.036932 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:38.046080 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:38.046679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:38.047110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:38.047831 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:38.048304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:38.048722 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:38.181067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:38.190266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:38.191693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:38.192865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c001d326-952b-4930-bfae-483c87cc7f39 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.160535 Sep 28 07:30:38.193466 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 359/694] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:38 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:38.263738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:38.264617 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:38.270989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:38.271487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:38.271928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:38.272629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:38.273239 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:38.273837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:38.420505 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:38.430614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-077c9847-b3f3-4480-9e36-22ec9c88fa71 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1265 microversion: 2.1 time: 0.170768 Sep 28 07:30:38.431571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 336/695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:38 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:38.584594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:38.585598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:38.595605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:38.596238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:38.596739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:38.597534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:38.598012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:38.598426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:38.669184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:38.678300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9515fd6a-d52e-4166-b195-8b09e6b1a961 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1294 microversion: 2.1 time: 0.097532 Sep 28 07:30:38.678815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 360/696] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:38 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:39.218749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:39.219288 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:39.225396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.226285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.229498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.230212 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.230837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.231260 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.438225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:39.446868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:39.448323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:39.449754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-627ebacf-03b7-4555-b305-7a036c0292ba tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.235178 Sep 28 07:30:39.450489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 337/697] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:39 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:39.455088 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:39.456258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:39.464144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.464820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.465451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.466438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.467074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.467818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.621842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:39.631179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5c3e6aaa-46cb-47da-9996-1d4f0b89704e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1452 microversion: 2.1 time: 0.180949 Sep 28 07:30:39.632484 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 361/698] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:39 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:39.656432 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:39.657082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:39.664162 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.664857 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.665500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.666374 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.666827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.667252 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.702370 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:39.704176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:39.713816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.714521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.715092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.715921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:39.718350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:39.718964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:39.895072 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:39.902094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad219a8d-2354-4649-b950-32f2c46f9d9c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.203205 Sep 28 07:30:39.909557 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 362/699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:39 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:39.939207 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:39.948268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c1ff0d15-6439-4531-a4f8-44ac06486f91 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1452 microversion: 2.1 time: 0.296285 Sep 28 07:30:39.948859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 338/700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:39 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1452 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:40.478754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:40.479814 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:40.491460 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:40.491963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:40.492400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:40.493138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:40.493592 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:40.494017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:40.707392 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-59481b4a-844b-4f38-a8bd-8a5ec48f585f req-e98c19f8-fa5a-46bc-99ac-6ac1d29caedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d19308-3fa5-46ed-b637-39d895095aed", "tag": "9761dab3-6f7c-4dc0-94df-407f871849f1"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:40.722854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-59481b4a-844b-4f38-a8bd-8a5ec48f585f req-e98c19f8-fa5a-46bc-99ac-6ac1d29caedf service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:40.723218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:40.723921 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-59481b4a-844b-4f38-a8bd-8a5ec48f585f req-e98c19f8-fa5a-46bc-99ac-6ac1d29caedf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:40.724672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-59481b4a-844b-4f38-a8bd-8a5ec48f585f req-e98c19f8-fa5a-46bc-99ac-6ac1d29caedf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:40.738641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-59481b4a-844b-4f38-a8bd-8a5ec48f585f req-e98c19f8-fa5a-46bc-99ac-6ac1d29caedf service nova] Creating event network-changed:9761dab3-6f7c-4dc0-94df-407f871849f1 for instance a6d19308-3fa5-46ed-b637-39d895095aed on hv-cinder-85944 Sep 28 07:30:40.738838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:40.741741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:40.745137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-59481b4a-844b-4f38-a8bd-8a5ec48f585f req-e98c19f8-fa5a-46bc-99ac-6ac1d29caedf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045316 Sep 28 07:30:40.745657 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-852988b8-9226-4091-9969-a741a374127a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.268475 Sep 28 07:30:40.746246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 363/701] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:40 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:40.761142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 339/702] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:40.927468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:40.928656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:40.938128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:40.939030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:40.939699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:40.940700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:40.941382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:40.942350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:41.171325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:41.196203 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-015ec318-a300-4b74-9381-6d3345ed9289 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.272371 Sep 28 07:30:41.201038 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 340/703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:40 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:41.771861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:41.772456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:41.778711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:41.779729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:41.780350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:41.781064 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:41.781508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:41.782089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:41.974723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:41.987976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:41.990163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:41.991762 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ee4e048-af25-4e5b-acdc-c8e74da540a7 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1744 microversion: 2.20 time: 0.223952 Sep 28 07:30:41.992486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 364/704] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:41 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:42.026150 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-ca50805b-9a73-41c7-8bab-91e5d1eb4566 req-9a6b99fe-824f-40e5-8d71-ed199fa7ba71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e62a15-55d5-43ca-a578-13300d349c53", "tag": "c820c0dd-b904-418b-a64a-a70ba69e8c04"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:42.036607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-ca50805b-9a73-41c7-8bab-91e5d1eb4566 req-9a6b99fe-824f-40e5-8d71-ed199fa7ba71 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:42.037393 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-ca50805b-9a73-41c7-8bab-91e5d1eb4566 req-9a6b99fe-824f-40e5-8d71-ed199fa7ba71 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:42.037825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-ca50805b-9a73-41c7-8bab-91e5d1eb4566 req-9a6b99fe-824f-40e5-8d71-ed199fa7ba71 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:42.050154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-ca50805b-9a73-41c7-8bab-91e5d1eb4566 req-9a6b99fe-824f-40e5-8d71-ed199fa7ba71 service nova] Creating event network-changed:c820c0dd-b904-418b-a64a-a70ba69e8c04 for instance a4e62a15-55d5-43ca-a578-13300d349c53 on hv-cinder-85944 Sep 28 07:30:42.055221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-ca50805b-9a73-41c7-8bab-91e5d1eb4566 req-9a6b99fe-824f-40e5-8d71-ed199fa7ba71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033533 Sep 28 07:30:42.055811 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 341/705] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:42.219200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:42.219911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:42.225889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:42.226448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:42.226949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:42.227713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:42.228236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:42.228746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:42.363515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:42.371217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-85664ef8-d27a-42f9-ab23-96bac25a71b2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.156036 Sep 28 07:30:42.371819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 365/706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:42 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:43.022121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:43.022809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:43.030717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:43.031339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:43.032033 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:43.032303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:43.032753 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:43.033389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:43.228604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:43.237767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:43.239219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:43.240390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bdf6153f-f02e-4c0a-8d49-0ad7115cc65e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1744 microversion: 2.20 time: 0.222647 Sep 28 07:30:43.240984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 342/707] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:43 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:43.394562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:43.395181 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:43.401803 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:43.402291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:43.402728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:43.403423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:43.404081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:43.405020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:43.539979 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:43.548126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bd5c4af2-63f0-4e3e-95e2-f8b550cbfdac tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.157445 Sep 28 07:30:43.548903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 366/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:43 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:44.183730 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-e8071cd9-d77f-4d83-b458-fa1d44b5b101 req-642a5a9d-674b-4971-a4c3-f617e6fb3398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "name": "network-vif-plugged", "status": "completed", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:44.194737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e8071cd9-d77f-4d83-b458-fa1d44b5b101 req-642a5a9d-674b-4971-a4c3-f617e6fb3398 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:44.195071 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e8071cd9-d77f-4d83-b458-fa1d44b5b101 req-642a5a9d-674b-4971-a4c3-f617e6fb3398 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:44.195500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e8071cd9-d77f-4d83-b458-fa1d44b5b101 req-642a5a9d-674b-4971-a4c3-f617e6fb3398 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:44.210956 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-e8071cd9-d77f-4d83-b458-fa1d44b5b101 req-642a5a9d-674b-4971-a4c3-f617e6fb3398 service nova] Creating event network-vif-plugged:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:30:44.215934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-e8071cd9-d77f-4d83-b458-fa1d44b5b101 req-642a5a9d-674b-4971-a4c3-f617e6fb3398 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036286 Sep 28 07:30:44.217136 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 343/709] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:44.268675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:44.269397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:44.276155 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:44.276759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:44.277460 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:44.278259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:44.278817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:44.279391 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:44.429279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:44.438426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:44.439867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:44.441075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5711503b-b549-4375-a8e7-688139bfd719 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.177157 Sep 28 07:30:44.441649 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 367/710] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:44 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:44.572111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:44.572930 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:44.582623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:44.583140 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:44.583609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:44.585255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:44.585880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:44.586466 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:44.751475 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:44.760810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e3dcda1a-5a79-489e-babb-bed62373b823 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.192901 Sep 28 07:30:44.774132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 344/711] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:44 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:45.469376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:45.470631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:45.477463 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:45.478204 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:45.478965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:45.480253 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:45.480709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:45.481356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:45.637144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:45.647220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:45.649683 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:45.650122 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e700ca11-2352-4d95-a577-828158e2d8d8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.186748 Sep 28 07:30:45.650667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 368/712] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:45 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:45.786219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:45.791045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:45.798501 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:45.799124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:45.799656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:45.800421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:45.801024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:45.801551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:45.810262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=100 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:45.987945 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:45.999909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b7ae0ef5-d98d-4491-9802-3af687167128 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.217503 Sep 28 07:30:46.000667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 345/713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:45 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:30:46.239024 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-275a4f47-6a86-49ad-99f9-53fbe73732a3 req-7f477c16-4974-4d59-bb2d-e42b62c43728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d19308-3fa5-46ed-b637-39d895095aed", "name": "network-vif-plugged", "status": "completed", "tag": "9761dab3-6f7c-4dc0-94df-407f871849f1"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:46.250021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-275a4f47-6a86-49ad-99f9-53fbe73732a3 req-7f477c16-4974-4d59-bb2d-e42b62c43728 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:46.250505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-275a4f47-6a86-49ad-99f9-53fbe73732a3 req-7f477c16-4974-4d59-bb2d-e42b62c43728 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:46.251114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-275a4f47-6a86-49ad-99f9-53fbe73732a3 req-7f477c16-4974-4d59-bb2d-e42b62c43728 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:46.255301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:46.264371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-275a4f47-6a86-49ad-99f9-53fbe73732a3 req-7f477c16-4974-4d59-bb2d-e42b62c43728 service nova] Creating event network-vif-plugged:9761dab3-6f7c-4dc0-94df-407f871849f1 for instance a6d19308-3fa5-46ed-b637-39d895095aed on hv-cinder-85944 Sep 28 07:30:46.270200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-275a4f47-6a86-49ad-99f9-53fbe73732a3 req-7f477c16-4974-4d59-bb2d-e42b62c43728 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034732 Sep 28 07:30:46.271321 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 369/714] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:46.679716 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:46.680523 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:46.686914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:46.687602 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=10 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:46.695365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:46.701549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:46.702346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:46.703175 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:46.704184 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:46.704287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:46.840288 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:46.851342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:46.853472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:46.854649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fa3592aa-d560-4089-9b50-4278cce17eb3 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.179031 Sep 28 07:30:46.868971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 346/715] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:46 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:47.020843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:47.028497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:47.029575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:47.039426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:47.040435 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:47.041108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:47.042397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:47.043301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:47.044049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:47.194963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:47.203835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-60c3d4ad-c9c5-4198-b7e4-9dfb9ce6ee9e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.184696 Sep 28 07:30:47.204496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 370/716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:47 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:47.880653 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:47.882124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:47.889840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:47.890721 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:47.891157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:47.891849 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:47.892349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:47.892793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:48.037006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:48.046310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:48.047838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:48.049333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-aea99bbb-74dd-43d7-adbc-39cf29e0e271 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.172714 Sep 28 07:30:48.050122 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 347/717] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:47 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:48.226594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:48.228156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:48.237134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:48.238075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:48.238755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:48.239676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:48.240345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:48.241324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:48.399362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:48.407964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1ed26fdd-076a-4401-a2a9-17b59d5fc548 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1368 microversion: 2.1 time: 0.185185 Sep 28 07:30:48.408737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 371/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:48 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:49.075832 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:49.077589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:49.084895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:49.085399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:49.085991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:49.086908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:49.087541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:49.088119 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:49.225371 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:49.236880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:49.238384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:49.239542 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0135757c-9b85-41b6-a568-ee96fdc93933 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.167830 Sep 28 07:30:49.240106 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 348/719] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:49 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:49.435548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:49.436161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:49.442365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:49.442846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:49.443270 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:49.443953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:49.444394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:49.444809 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:49.595036 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:49.602771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca84d772-b9cf-413c-8c53-8d203f50e524 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1558 microversion: 2.1 time: 0.174604 Sep 28 07:30:49.603333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 372/720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:30:49 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:30:49.626280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:49.626766 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:49.632932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:49.633663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:49.634285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:49.635135 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:49.635747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:49.636162 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:49.726395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ec78851c-9bd4-491d-83e8-78b4ce5d2d7e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104702 Sep 28 07:30:49.727899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 349/721] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:30:49 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:50.271575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:50.272305 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:50.286729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:50.287234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:50.287967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:50.295946 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:50.296586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:50.297132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:50.777619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:50.790017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:50.791771 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:50.793193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a175a0ed-d2c5-4332-a32b-8f8a1ca44177 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.527517 Sep 28 07:30:50.793947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 373/722] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:50 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:30:51.049466 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-f001b3b5-c9b3-47cb-b677-8c58f4518ec9 req-295a1c6f-4a09-4d9f-944d-beb304227213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d19308-3fa5-46ed-b637-39d895095aed", "tag": "9761dab3-6f7c-4dc0-94df-407f871849f1"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:51.067076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f001b3b5-c9b3-47cb-b677-8c58f4518ec9 req-295a1c6f-4a09-4d9f-944d-beb304227213 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:51.067931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f001b3b5-c9b3-47cb-b677-8c58f4518ec9 req-295a1c6f-4a09-4d9f-944d-beb304227213 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:51.068586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f001b3b5-c9b3-47cb-b677-8c58f4518ec9 req-295a1c6f-4a09-4d9f-944d-beb304227213 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:51.084843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-f001b3b5-c9b3-47cb-b677-8c58f4518ec9 req-295a1c6f-4a09-4d9f-944d-beb304227213 service nova] Creating event network-changed:9761dab3-6f7c-4dc0-94df-407f871849f1 for instance a6d19308-3fa5-46ed-b637-39d895095aed on hv-cinder-85944 Sep 28 07:30:51.093575 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-f001b3b5-c9b3-47cb-b677-8c58f4518ec9 req-295a1c6f-4a09-4d9f-944d-beb304227213 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045422 Sep 28 07:30:51.097300 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 350/723] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:51.823919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:51.824467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:51.836097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:51.836593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:51.837075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:51.837777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:51.838222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:51.838638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:52.020517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:52.031791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:52.033244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:52.034558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c38fea04-f61f-49da-bcc8-5fb4eadc136e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.215923 Sep 28 07:30:52.053015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 374/724] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:51 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:53.061700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:53.062457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:53.067524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:53.069459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:53.069940 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:53.070363 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:53.071223 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:53.071675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:53.072230 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:53.216065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:53.225070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:53.226522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:53.227682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-38786434-c74c-481a-a45f-dd8ee6f02b1d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.171692 Sep 28 07:30:53.228425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 351/725] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:53 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:54.256068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:54.256689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:54.263009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:54.263482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:54.263930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:54.264576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:54.265045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:54.265462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:54.394695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:54.402632 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:54.404636 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:54.406153 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee131379-207b-410d-afab-9ab01169bd77 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1739 microversion: 2.20 time: 0.154002 Sep 28 07:30:54.406708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 375/726] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:54 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:55.436068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:55.436672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:55.443234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:55.443713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:55.444149 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:55.444833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:55.445311 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:55.445733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:55.577998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:55.585951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:55.587373 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:55.588541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ffee0cd8-529f-4061-a550-73dc2e89174f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1721 microversion: 2.20 time: 0.157431 Sep 28 07:30:55.589124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 352/727] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:55 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:30:56.614008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:56.614640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:56.616865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=71 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:30:56.622145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:56.622622 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:56.623074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:56.623799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:56.624244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:56.624684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:56.760090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:56.768840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:56.770307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:56.771453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-952da685-ba2c-4b56-8adf-c1b250d37e88 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1721 microversion: 2.20 time: 0.161321 Sep 28 07:30:56.772015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 376/728] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:56 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:57.797545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:57.798170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:57.804925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:57.805444 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:57.805877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:57.806565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:57.807015 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:57.807433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:57.939287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:57.947465 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:57.948928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:57.951597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4c97a2f9-676d-4f04-8f86-609843e0cc0c tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1721 microversion: 2.20 time: 0.157313 Sep 28 07:30:57.951597 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 353/729] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:57 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:58.088201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a16c1d4a-bad8-4f18-bd68-7f4b725c81ce req-80743dca-0baa-4a44-b0b7-ec910f23e966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:58.098820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a16c1d4a-bad8-4f18-bd68-7f4b725c81ce req-80743dca-0baa-4a44-b0b7-ec910f23e966 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:58.099314 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a16c1d4a-bad8-4f18-bd68-7f4b725c81ce req-80743dca-0baa-4a44-b0b7-ec910f23e966 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:58.099733 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a16c1d4a-bad8-4f18-bd68-7f4b725c81ce req-80743dca-0baa-4a44-b0b7-ec910f23e966 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:58.110944 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a16c1d4a-bad8-4f18-bd68-7f4b725c81ce req-80743dca-0baa-4a44-b0b7-ec910f23e966 service nova] Creating event network-vif-unplugged:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:30:58.115983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a16c1d4a-bad8-4f18-bd68-7f4b725c81ce req-80743dca-0baa-4a44-b0b7-ec910f23e966 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031464 Sep 28 07:30:58.116576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 377/730] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:30:58.975673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:58.976220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:58.983751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:58.984240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:58.984677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:58.985406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:58.985859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:58.986282 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.109775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:59.117716 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:59.119196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:30:59.120346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-62b5961e-bef0-4026-8ad2-b59d4448db74 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1664 microversion: 2.20 time: 0.148667 Sep 28 07:30:59.120906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 354/731] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:58 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:30:59.145691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42a26577-fb64-466c-9dd8-f53ffd5854af"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:59.148051 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:59.154533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.155034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.155427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.156102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.156546 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.157003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.427727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5267f389-0dbe-4fb1-9326-7991ef246dc4 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286809 Sep 28 07:30:59.428364 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 378/732] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Sep 28 07:30:59 2022] POST /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 07:30:59.552692 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:59.553202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:59.559019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.559497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.560183 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.561042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.561498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.561918 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.797734 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e0cad226-ff70-446d-9147-989c09f83c7d tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-volume_attachments/42a26577-fb64-466c-9dd8-f53ffd5854af" status: 202 len: 0 microversion: 2.20 time: 0.248888 Sep 28 07:30:59.798324 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 355/733] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Sep 28 07:30:59 2022] DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-volume_attachments/42a26577-fb64-466c-9dd8-f53ffd5854af => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:30:59.860052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:30:59.860667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:59.866839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.867325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.867759 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.868447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.868900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.869354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.900728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 07:30:59.967842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f6987c54-92e7-42e2-99a6-73791d3538f8 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "POST /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/action" status: 202 len: 0 microversion: 2.20 time: 0.111939 Sep 28 07:30:59.968449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 379/734] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 07:30:59 2022] POST /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:30:59.976532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:30:59.977176 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:30:59.983718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.984202 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.984632 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:30:59.985366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:30:59.985819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:30:59.986246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:00.127161 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:00.136017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:00.137605 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:00.139520 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ff286af1-267d-4042-98e8-ed73d9c58a21 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1672 microversion: 2.20 time: 0.166937 Sep 28 07:31:00.140227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 356/735] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:30:59 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:01.166335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:01.166946 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:01.173576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:01.174067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:01.174473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:01.175146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:01.175598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:01.176014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:01.306273 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:01.314518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:01.315960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:01.317144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c3d52176-a677-41f4-a558-1428c628ca0b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.155228 Sep 28 07:31:01.317704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 380/736] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:01 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:02.343406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:02.344055 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:02.350525 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:02.351009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:02.351445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:02.352139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:02.352590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:02.353040 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:02.556424 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:02.566100 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:02.567809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:02.568979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e1888d8f-12ad-453b-ab25-f884c07c7bdc tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.230236 Sep 28 07:31:02.569538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 357/737] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:02 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:03.595340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:03.595929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:03.602291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:03.602770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:03.603197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:03.603904 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:03.604365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:03.604784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:03.742025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:03.750487 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:03.751944 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:03.753136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b91253b-fdc1-4ebb-9b2a-931325ba23ef tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.162174 Sep 28 07:31:03.753691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 381/738] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:03 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:04.779807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:04.781374 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:04.788712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:04.789223 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:04.789654 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:04.790347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:04.790790 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:04.791206 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:04.928656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:04.939851 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:04.941527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:04.942774 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-71319223-fd50-442b-9ec9-5985fbda93ff tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.168229 Sep 28 07:31:04.943724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 358/739] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:04 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:05.970241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:05.970794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:05.977279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:05.977770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:05.978204 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:05.978904 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:05.979356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:05.979985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:06.124180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:06.132715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:06.134203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:06.135364 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8527e608-5517-4e9b-8a59-6edef1b1584b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.170271 Sep 28 07:31:06.135917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 382/740] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:05 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:07.167949 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:07.168548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:07.175614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:07.176090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:07.176514 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:07.177230 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:07.177678 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:07.178090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:07.315303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:07.323237 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:07.324664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:07.326353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3d613a45-1aa0-4c66-8ee5-01fe4f0543e0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.161826 Sep 28 07:31:07.326986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 359/741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:07 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:08.353304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:08.353906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:08.361067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:08.361599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:08.362102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:08.362854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:08.363298 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:08.363712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:08.381924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:08.501197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:08.509426 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:08.510892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:08.512070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4c9fcc04-b1ca-4943-968b-2e67a32a08ad tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.162663 Sep 28 07:31:08.512630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 383/742] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:08 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:09.538503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:09.539146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:09.545963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:09.546684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:09.547221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:09.547920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:09.548369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:09.548787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:09.564884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:09.683452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:09.693280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:09.694828 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:09.696413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6570830b-7c95-430b-8c37-1b6017324306 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.161791 Sep 28 07:31:09.697435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 360/743] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:09 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:10.723649 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:10.724296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:10.731389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:10.731948 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:10.732454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:10.733375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:10.734089 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:10.734546 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:10.874734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:10.883671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:10.885548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:10.886945 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cd7ae3d-411a-4ed1-bfed-02a023e52828 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.167654 Sep 28 07:31:10.893111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 384/744] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:10 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:11.913931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:11.914520 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:11.921570 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:11.922050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:11.922483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:11.923162 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:11.923607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:11.924020 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:12.056362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:12.066868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:12.068326 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:12.069522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-773cd00e-e8c2-46f5-b5f6-ee4e6a816179 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.159471 Sep 28 07:31:12.070078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 361/745] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:11 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:13.095470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:13.096097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:13.102406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:13.102877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:13.103332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:13.104151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:13.104660 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:13.105104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:13.241990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:13.250903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:13.252402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:13.253619 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34b01737-9644-4a23-ab6e-27541459b25a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.162365 Sep 28 07:31:13.254301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 385/746] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:13 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:14.279416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:14.280032 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:14.287343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:14.287869 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:14.288382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:14.289226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:14.289757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:14.290250 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:14.433141 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:14.442606 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:14.444048 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:14.445236 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f72b61ce-30c0-4730-90fa-6729cb0e8703 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.169814 Sep 28 07:31:14.449118 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 362/747] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:14 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:15.471322 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:15.471895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:15.478586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:15.479057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:15.479480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:15.480150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:15.480597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:15.481029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:15.611284 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:15.619298 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:15.620738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:15.621918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c1954459-6026-43b7-8218-fd317b317c67 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.155269 Sep 28 07:31:15.622481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 386/748] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:15 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:16.647247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:16.647859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:16.654355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:16.654861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:16.655324 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:16.656502 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:16.657044 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:16.657464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:16.945194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:16.953906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:16.955343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:16.956516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4839759b-e70c-4d74-aabc-a276d2ba3888 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.313206 Sep 28 07:31:16.957077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 363/749] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:16 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:17.981974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:17.982598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:17.989864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:17.990347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:17.990785 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:17.991475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:17.991930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:17.992345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:18.121856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:18.131378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:18.133237 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:18.134514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4183ef9c-1655-48a3-9792-8193f62e52f6 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.156418 Sep 28 07:31:18.135084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 387/750] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:17 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:19.160149 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:19.160761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:19.167087 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:19.167571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:19.168004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:19.168699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:19.169176 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:19.169596 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:19.301771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:19.309702 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:19.311373 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:19.313173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-847b4b58-297f-4688-9448-cd0f9ff20d8b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.156762 Sep 28 07:31:19.313779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 364/751] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:19 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:20.290916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-54c52267-da49-4082-bd44-467b55dd7bac req-88aafef4-46a4-49c8-a20b-8cdff5b5dfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "name": "network-vif-plugged", "status": "completed", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:31:20.301613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54c52267-da49-4082-bd44-467b55dd7bac req-88aafef4-46a4-49c8-a20b-8cdff5b5dfb3 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:20.302175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54c52267-da49-4082-bd44-467b55dd7bac req-88aafef4-46a4-49c8-a20b-8cdff5b5dfb3 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:20.302606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-54c52267-da49-4082-bd44-467b55dd7bac req-88aafef4-46a4-49c8-a20b-8cdff5b5dfb3 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:20.314848 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-54c52267-da49-4082-bd44-467b55dd7bac req-88aafef4-46a4-49c8-a20b-8cdff5b5dfb3 service nova] Creating event network-vif-plugged:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:31:20.319810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-54c52267-da49-4082-bd44-467b55dd7bac req-88aafef4-46a4-49c8-a20b-8cdff5b5dfb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Sep 28 07:31:20.320400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 388/752] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:20.338083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:20.338685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:20.345508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:20.346246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:20.346675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:20.347371 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:20.347813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:20.348398 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:20.480165 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:20.489123 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:20.490958 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:20.492128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7a715a14-cea1-4fbe-b9e6-9d65923cf08e tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.158051 Sep 28 07:31:20.492681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 365/753] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:20 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 07:31:21.519048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:21.519737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:21.525840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:21.526316 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:21.526745 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:21.527423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:21.527868 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:21.528285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:21.668224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:21.676431 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:21.677918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:21.679058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d0ed5d79-d0f9-49c8-864a-3b8c8755ba8a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.165398 Sep 28 07:31:21.679613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 389/754] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:21 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:22.705680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:22.706440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:22.712936 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:22.713434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:22.713864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:22.714544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:22.714992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:22.715408 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:22.840831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:22.849496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:22.850929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:22.852080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7353f4c0-2d83-4682-9dfb-67659470d005 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1730 microversion: 2.20 time: 0.152202 Sep 28 07:31:22.852622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 366/755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:22 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:23.878264 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:23.878963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:23.887028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:23.887503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:23.887925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:23.888628 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:23.889105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:23.889517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:24.014834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:24.022926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:24.024360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:24.025545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-10998473-9d8f-4b73-b9ba-30bef58986c0 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1717 microversion: 2.20 time: 0.152571 Sep 28 07:31:24.026101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 390/756] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:31:23 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:31:29.010780 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:29.011309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:29.013496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=32 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:29.019713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:29.020189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:29.020616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:29.021320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:29.021769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:29.022185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:29.045252 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ddc73802-5b62-4f63-a82b-bc835c4d4ef6 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/ips" status: 200 len: 146 microversion: 2.1 time: 0.038337 Sep 28 07:31:29.045797 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 367/757] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:31:29 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:31:30.377699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e37462ec-ec97-4f6b-8e96-0039336a4e12"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:31:30.380118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:30.382659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:30.387956 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:30.388436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:30.388867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:30.389570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:30.390019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:30.390437 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:30.661607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e7f39fe0-33b6-4cb4-b7eb-597d4dff0c0e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287694 Sep 28 07:31:30.662220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 391/758] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:31:30 2022] POST /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:38.196094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:38.198347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:38.204915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:38.205454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:38.205884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:38.206564 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:38.207012 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:38.207428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:38.237042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-871a6721-bbd1-483b-bbc1-6915cb4c9e75 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Sep 28 07:31:38.237580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 368/759] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:31:38 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:38.249605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:38.250181 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:38.256643 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:38.257169 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:38.257599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:38.258280 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:38.258730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:38.259147 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:38.287671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6cc8a7b7-810d-4a94-bb7e-91a1a6fdf97a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e37462ec-ec97-4f6b-8e96-0039336a4e12" status: 200 len: 194 microversion: 2.1 time: 0.043232 Sep 28 07:31:38.288241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 392/760] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 07:31:38 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e37462ec-ec97-4f6b-8e96-0039336a4e12 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:39.620145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e940529c-c55b-430c-8f81-e3e01f197228"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:31:39.622568 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:39.629038 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:39.629516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:39.629944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:39.630622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:39.631072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:39.631489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:39.633809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=50 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:39.887422 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cc338e84-0c2b-4251-96b6-eb8405e098d1 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "POST /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271139 Sep 28 07:31:39.888205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 369/761] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:31:39 2022] POST /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:46.800684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:46.801342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:46.808354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:46.808883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:46.809338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:46.810026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:46.810474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:46.811144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:46.815028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:46.837605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6fc88ec0-c82a-41ff-9aff-f6a6342df653 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/ips" status: 200 len: 150 microversion: 2.1 time: 0.041480 Sep 28 07:31:46.838181 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 393/762] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:31:46 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:47.425177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:47.427387 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:47.433991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:47.434501 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:47.434937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:47.435621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:47.436328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:47.436749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:47.467836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9bd58df1-8155-409c-b1e1-7abe5b4ab4be tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046889 Sep 28 07:31:47.468383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 370/763] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:31:47 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:47.582328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:47.582740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:47.589472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:47.589951 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:47.590380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:47.591059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:47.591505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:47.591923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:47.622555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-90107225-20a1-4fc2-ae71-de261626517f tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e37462ec-ec97-4f6b-8e96-0039336a4e12" status: 200 len: 194 microversion: 2.1 time: 0.044946 Sep 28 07:31:47.623125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 394/764] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 07:31:47 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e37462ec-ec97-4f6b-8e96-0039336a4e12 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:47.634195 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:47.634747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:47.640973 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:47.641458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:47.641890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:47.642614 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:47.643083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:47.643483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:47.722825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lazy-loading 'services' on Instance uuid 1db94c92-043c-4834-903c-2a192fe45d02 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:31:47.796848 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4f0a0ce8-d426-4cab-be0f-6825ac7026bc tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e37462ec-ec97-4f6b-8e96-0039336a4e12" status: 202 len: 0 microversion: 2.1 time: 0.166347 Sep 28 07:31:47.797483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 371/765] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:31:47 2022] DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e37462ec-ec97-4f6b-8e96-0039336a4e12 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:31:48.198973 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ab062fa-9232-429a-8b6e-6029bc10788e"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:31:48.201479 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:48.208110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:48.208589 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:48.209052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:48.209761 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:48.210212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:48.210629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:48.457269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0f29f9ab-6eda-401d-850e-760d343e89af tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261959 Sep 28 07:31:48.457965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 395/766] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:31:48 2022] POST /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:49.977916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:49.978520 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:49.985246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:49.985724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:49.986156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:49.986874 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:49.987511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:49.988042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:50.016480 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7689dbdd-ea4a-4aca-b19e-e9294a69d02a tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e940529c-c55b-430c-8f81-e3e01f197228" status: 200 len: 194 microversion: 2.1 time: 0.042811 Sep 28 07:31:50.017056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 372/767] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 07:31:49 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e940529c-c55b-430c-8f81-e3e01f197228 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:50.029200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:50.029783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:50.036838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:50.037341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:50.037778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:50.038463 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:50.038915 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:50.039338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:50.117937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lazy-loading 'services' on Instance uuid 1db94c92-043c-4834-903c-2a192fe45d02 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:31:50.187375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e517c19-7c49-480e-a5d3-20f455048b12 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e940529c-c55b-430c-8f81-e3e01f197228" status: 202 len: 0 microversion: 2.1 time: 0.162741 Sep 28 07:31:50.188105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 396/768] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:31:50 2022] DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments/e940529c-c55b-430c-8f81-e3e01f197228 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:31:56.000594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ab0c583d-6434-4505-a8c9-ae1c3313ef96 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: .version_select at 0x7fa861d7a280>, body: {"keypair": {"name": "tempest-keypair-896323644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIuQ1HGNP1Awb1HsEJnrspOKXJGFUx4B+qtmLemVmHW8abMaKhwENifq3JgyuImQ0BIfqy5jgkKavbHBaWvdnOOeMAMv/dLPr5OCq79DPLMmf/n6fcQJYh+4dEgLeFvow=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:31:56.016090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-ab0c583d-6434-4505-a8c9-ae1c3313ef96 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:31:56.020329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-ab0c583d-6434-4505-a8c9-ae1c3313ef96 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:31:56.041819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ab0c583d-6434-4505-a8c9-ae1c3313ef96 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045180 Sep 28 07:31:56.042865 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 373/769] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:31:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:31:56.677503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:56.679902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:56.687318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:56.687809 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:56.688256 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:56.688962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:56.689425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:56.690022 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:56.724620 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-54524a6d-c0d9-448c-9a05-d7ddb0125ed7 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053091 Sep 28 07:31:56.730675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 397/770] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:31:56 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:31:56.850334 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:56.852691 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:56.859878 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:56.860364 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:56.860801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:56.861522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:56.861976 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:56.863005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:56.894681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ea035446-6b27-47d6-94dd-3e4b3f44b5d9 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048939 Sep 28 07:31:56.895257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 374/771] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:31:56 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:31:56.960508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:56.961101 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:56.966939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:56.967422 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:56.967854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:56.968556 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:56.969252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:56.969902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:56.996503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:31:57.077037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8070c12d-c8aa-4bf8-a3ab-3871ea91c21d tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 204 len: 0 microversion: 2.1 time: 0.119968 Sep 28 07:31:57.079659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 398/772] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:31:56 2022] DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:31:57.088130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:57.088731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:57.095261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:57.095748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:57.096185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:57.097689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:57.098153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:57.098579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:57.276712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:57.285248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9d6600cf-1213-4444-b52d-8929f64737f5 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1675 microversion: 2.1 time: 0.200917 Sep 28 07:31:57.285821 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 375/773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:31:57 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:31:57.415406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-608423033", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "733608a5-23eb-466d-8629-abe8aafc7bed"}], "security_groups": [{"name": "tempest-securitygroup--123945403"}], "key_name": "tempest-keypair-896323644", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:31:57.517063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] validate_networks() for [('733608a5-23eb-466d-8629-abe8aafc7bed', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:31:57.879385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:31:57.879983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:31:57.880279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:31:57.880675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:31:57.881123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:31:57.889614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:57.890085 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:57.890506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:57.891214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:57.891656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:57.892068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:57.908651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:31:57.912581 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:31:57.923076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:31:57.925743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:31:57.975393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-078f4227-889d-4cb9-a8be-f52a4a6b4d0f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564687 Sep 28 07:31:57.976041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 399/774] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:31:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:31:57.987118 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d58d9d9e-8ab0-423d-b246-19600bd29ff4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:57.987689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d58d9d9e-8ab0-423d-b246-19600bd29ff4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:58.040556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d58d9d9e-8ab0-423d-b246-19600bd29ff4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:58.048495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d58d9d9e-8ab0-423d-b246-19600bd29ff4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1240 microversion: 2.1 time: 0.065200 Sep 28 07:31:58.049388 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 376/775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:31:57 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:31:58.309925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:58.311177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:58.322883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:58.323470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:58.324068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:58.324990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:58.325729 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:58.326403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:58.453681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:58.461553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bb13ddbc-4374-4171-aae4-49087b77b415 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1675 microversion: 2.1 time: 0.156901 Sep 28 07:31:58.462217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 400/776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:31:58 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:31:59.071395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:59.072034 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:59.074731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:31:59.082713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:59.083112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:59.083565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:59.084253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:59.084700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:59.085151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:59.144205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:59.151701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-03d6db62-af5b-4ada-a982-081e3259448f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1236 microversion: 2.1 time: 0.084124 Sep 28 07:31:59.152252 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 377/777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:31:59 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:31:59.486148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:31:59.486864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:31:59.493598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:59.494083 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:59.494518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:59.495213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:31:59.495667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:31:59.496093 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:31:59.628938 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:31:59.636773 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-720088fa-1684-4890-a155-02d0afdedc96 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1675 microversion: 2.1 time: 0.155368 Sep 28 07:31:59.637376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 401/778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:31:59 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:00.175694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:00.176248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:00.182702 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:00.183702 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:00.183702 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:00.184394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:00.184854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:00.185312 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:00.280398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-90f149d3-ec62-4630-9359-bac3ee22ec0a req-94bc297e-6a0a-410d-85d7-9ee6c572fd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db94c92-043c-4834-903c-2a192fe45d02", "name": "network-vif-deleted", "tag": "ee66bf46-3d63-4bf1-879b-6e217b8ac1d2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:00.296191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-90f149d3-ec62-4630-9359-bac3ee22ec0a req-94bc297e-6a0a-410d-85d7-9ee6c572fd85 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:00.296819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-90f149d3-ec62-4630-9359-bac3ee22ec0a req-94bc297e-6a0a-410d-85d7-9ee6c572fd85 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:00.297441 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-90f149d3-ec62-4630-9359-bac3ee22ec0a req-94bc297e-6a0a-410d-85d7-9ee6c572fd85 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:00.308288 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:00.310365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-90f149d3-ec62-4630-9359-bac3ee22ec0a req-94bc297e-6a0a-410d-85d7-9ee6c572fd85 service nova] Creating event network-vif-deleted:ee66bf46-3d63-4bf1-879b-6e217b8ac1d2 for instance 1db94c92-043c-4834-903c-2a192fe45d02 on hv-cinder-85944 Sep 28 07:32:00.316307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-90f149d3-ec62-4630-9359-bac3ee22ec0a req-94bc297e-6a0a-410d-85d7-9ee6c572fd85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041203 Sep 28 07:32:00.317454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 402/779] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:00.328447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fa7787e0-b108-4017-9866-ff2816d4a5e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1298 microversion: 2.1 time: 0.157278 Sep 28 07:32:00.332654 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 378/780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:00 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1298 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:00.662310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:00.664104 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:00.665259 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:00.670249 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:00.670733 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:00.671163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:00.671854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:00.672301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:00.672716 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:00.716031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:00.716475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:00.717028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:00.718018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lazy-loading 'fault' on Instance uuid 1db94c92-043c-4834-903c-2a192fe45d02 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:32:00.758965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '269ef35368734dcd9d3cc901db39fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f391a1187074b68b3c6a887634b479b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:00.768269 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5f3a95d7-4ee0-4884-9c56-321adf67dc33 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 200 len: 1328 microversion: 2.1 time: 0.112003 Sep 28 07:32:00.769965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 403/781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:00 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 1328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:32:01.357219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:01.357822 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:01.364453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:01.365194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:01.365806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:01.366495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:01.366942 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:01.367360 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:01.610530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:01.619125 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7b82673f-b590-444a-93db-c9b0c2b6cb6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1365 microversion: 2.1 time: 0.265660 Sep 28 07:32:01.619697 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 379/782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:01 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:01.792034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:01.792691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:01.800499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:01.801100 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:01.801602 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:01.802386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:01.802910 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:01.803399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:01.825537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] HTTP exception thrown: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Request method failure captured: Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 HTTP/1.1 Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aZyXStU7d_Yo37b9yIrPz9UPHSK_DaRg_O3-U3kaSVEede7e0YlQMD51OQlIKLxJbEo9fMn_6UkSuIkTnq44wAgGAIV7WWTjzon8lunl8QVXvmU2Qavyk31kv9Wllt9VlnvAPd9vmAiPjdfh9ZphIUURU4tOrGj6AOrQYwtB00pdg Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:01.827187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f391a1187074b68b3c6a887634b479b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 269ef35368734dcd9d3cc901db39fe10 Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:01.828763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '1db94c92-043c-4834-903c-2a192fe45d02'} Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:01.829717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:01.831790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:01.833189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Returning 404 to user: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:01.833189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-918afd91-a436-4bcc-acbc-97d08e84e539 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 404 len: 111 microversion: 2.1 time: 0.040594 Sep 28 07:32:01.833189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 404/783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:01 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:32:01.838095 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-62e17255-0e25-4ba9-8988-09e80646e145 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '.version_select at 0x7fa861cfa940>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:01.857836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-62e17255-0e25-4ba9-8988-09e80646e145 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893037167" status: 202 len: 0 microversion: 2.1 time: 0.023504 Sep 28 07:32:01.858413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 380/784] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 07:32:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893037167 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:32:02.344132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-894aa301-6b9c-413a-92ea-a7a4dd652df4 req-a69a6e22-183b-4e6d-b398-f7ac621e7cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51bdb550-a2f4-43b5-a5b6-7faed7ef7be5", "tag": "1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:02.354592 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-894aa301-6b9c-413a-92ea-a7a4dd652df4 req-a69a6e22-183b-4e6d-b398-f7ac621e7cba service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:02.355326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-894aa301-6b9c-413a-92ea-a7a4dd652df4 req-a69a6e22-183b-4e6d-b398-f7ac621e7cba service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:02.355754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-894aa301-6b9c-413a-92ea-a7a4dd652df4 req-a69a6e22-183b-4e6d-b398-f7ac621e7cba service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:02.367353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-894aa301-6b9c-413a-92ea-a7a4dd652df4 req-a69a6e22-183b-4e6d-b398-f7ac621e7cba service nova] Creating event network-changed:1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77 for instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 on hv-cinder-85944 Sep 28 07:32:02.372583 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-894aa301-6b9c-413a-92ea-a7a4dd652df4 req-a69a6e22-183b-4e6d-b398-f7ac621e7cba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032305 Sep 28 07:32:02.373560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 405/785] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:02.641656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:02.642189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:02.649005 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:02.649486 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:02.649943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:02.650706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:02.651151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:02.651571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:02.790430 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:02.798189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-81c5394f-47be-415b-b9fe-2337016e4e0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1365 microversion: 2.1 time: 0.161022 Sep 28 07:32:02.798747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 381/786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:02 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:03.823707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:03.824411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:03.830847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:03.831707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:03.832149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:03.832899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:03.833429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:03.833811 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:03.978690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:03.986317 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-62fad256-fb79-4bf4-b9ca-0c99c3b92779 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1365 microversion: 2.1 time: 0.167331 Sep 28 07:32:03.986889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 406/787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:03 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:04.734445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:04.734951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:04.741833 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:04.742318 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:04.742758 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:04.743447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:04.743971 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:04.744392 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:04.760405 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] HTTP exception thrown: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Request method failure captured: Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 HTTP/1.1 Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aZyXStU7d_Yo37b9yIrPz9UPHSK_DaRg_O3-U3kaSVEede7e0YlQMD51OQlIKLxJbEo9fMn_6UkSuIkTnq44wAgGAIV7WWTjzon8lunl8QVXvmU2Qavyk31kv9Wllt9VlnvAPd9vmAiPjdfh9ZphIUURU4tOrGj6AOrQYwtB00pdg Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:32:04.762096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f391a1187074b68b3c6a887634b479b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 269ef35368734dcd9d3cc901db39fe10 Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.763627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '1db94c92-043c-4834-903c-2a192fe45d02'} Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:04.764476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.765938 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.767416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Returning 404 to user: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:04.767416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8c98f898-19fd-4367-83fc-edaa9d6c15ab tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 404 len: 111 microversion: 2.1 time: 0.032853 Sep 28 07:32:04.767416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 382/788] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:32:04 2022] DELETE /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:32:04.772000 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:04.772611 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 1db94c92-043c-4834-903c-2a192fe45d02] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:04.778471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:04.778963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:04.779383 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:04.780067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:04.780518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:04.780937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:04.794307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] HTTP exception thrown: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Request method failure captured: Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 HTTP/1.1 Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aZyXStU7d_Yo37b9yIrPz9UPHSK_DaRg_O3-U3kaSVEede7e0YlQMD51OQlIKLxJbEo9fMn_6UkSuIkTnq44wAgGAIV7WWTjzon8lunl8QVXvmU2Qavyk31kv9Wllt9VlnvAPd9vmAiPjdfh9ZphIUURU4tOrGj6AOrQYwtB00pdg Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:04.795916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f391a1187074b68b3c6a887634b479b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 269ef35368734dcd9d3cc901db39fe10 Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.797513 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '1db94c92-043c-4834-903c-2a192fe45d02'} Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:04.798289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. Sep 28 07:32:04.800394 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:04.801701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Returning 404 to user: Instance 1db94c92-043c-4834-903c-2a192fe45d02 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:04.801701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ff5c547d-355a-45c1-9fe5-c3169b21c40e tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02" status: 404 len: 111 microversion: 2.1 time: 0.029112 Sep 28 07:32:04.801701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 407/789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:04 2022] GET /compute/v2.1/servers/1db94c92-043c-4834-903c-2a192fe45d02 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:32:05.009640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:05.010253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:05.016276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:05.016803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:05.017313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:05.018008 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:05.019022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:05.019440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:05.155411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:05.164863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d6792161-68cb-4b62-89b4-f6b2a3851259 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1365 microversion: 2.1 time: 0.158898 Sep 28 07:32:05.165608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 383/790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:05 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:05.939404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:05.939902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:05.947073 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:05.947552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:05.947985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:05.948666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:05.949151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:05.949571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:05.963189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] HTTP exception thrown: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Request method failure captured: Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af HTTP/1.1 Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_aZyXStU7d_Yo37b9yIrPz9UPHSK_DaRg_O3-U3kaSVEede7e0YlQMD51OQlIKLxJbEo9fMn_6UkSuIkTnq44wAgGAIV7WWTjzon8lunl8QVXvmU2Qavyk31kv9Wllt9VlnvAPd9vmAiPjdfh9ZphIUURU4tOrGj6AOrQYwtB00pdg Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:05.964663 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f391a1187074b68b3c6a887634b479b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 269ef35368734dcd9d3cc901db39fe10 Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:05.966348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '475e52e8-57f8-4c53-b01d-52e19d35a1af'} Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:05.967229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:05.969353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:05.970959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Returning 404 to user: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:05.970959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eda44dfe-25f9-4abd-b155-edde69f5229b tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 404 len: 111 microversion: 2.1 time: 0.030687 Sep 28 07:32:05.970959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 408/791] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:32:05 2022] DELETE /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:32:05.976891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:05.977552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] [instance: 475e52e8-57f8-4c53-b01d-52e19d35a1af] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:05.985293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:05.985788 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:05.986424 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:05.987824 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:05.988342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:05.988834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:06.002199 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] HTTP exception thrown: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Request method failure captured: Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af HTTP/1.1 Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_aZyXStU7d_Yo37b9yIrPz9UPHSK_DaRg_O3-U3kaSVEede7e0YlQMD51OQlIKLxJbEo9fMn_6UkSuIkTnq44wAgGAIV7WWTjzon8lunl8QVXvmU2Qavyk31kv9Wllt9VlnvAPd9vmAiPjdfh9ZphIUURU4tOrGj6AOrQYwtB00pdg Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:32:06.004188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6f391a1187074b68b3c6a887634b479b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6f391a1187074b68b3c6a887634b479b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 6f391a1187074b68b3c6a887634b479b Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006047087 Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 269ef35368734dcd9d3cc901db39fe10 Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeTestJSON-1006047087-project Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:06.005792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '475e52e8-57f8-4c53-b01d-52e19d35a1af'} Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:06.006619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. Sep 28 07:32:06.008046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:06.009357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] Returning 404 to user: Instance 475e52e8-57f8-4c53-b01d-52e19d35a1af could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:06.009357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0daf83db-0099-4458-bdd5-8876c7df21d8 tempest-AttachVolumeTestJSON-1006047087 tempest-AttachVolumeTestJSON-1006047087-project] 10.222.0.52 "GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af" status: 404 len: 111 microversion: 2.1 time: 0.032581 Sep 28 07:32:06.009357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 384/792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:05 2022] GET /compute/v2.1/servers/475e52e8-57f8-4c53-b01d-52e19d35a1af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:32:06.187450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:06.188193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:06.193993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:06.194543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:06.195038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:06.195810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:06.196327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:06.196811 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:06.422794 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:06.430429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-174627dd-6767-4890-97f7-8a0aee2b1edb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1365 microversion: 2.1 time: 0.247137 Sep 28 07:32:06.431235 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 409/793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:06 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:06.604166 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-503e7208-fa85-416d-9d19-f5000bd23859 req-d3948aab-78b4-4285-a64e-047140e62ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51bdb550-a2f4-43b5-a5b6-7faed7ef7be5", "name": "network-vif-plugged", "status": "completed", "tag": "1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:06.615722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-503e7208-fa85-416d-9d19-f5000bd23859 req-d3948aab-78b4-4285-a64e-047140e62ccf service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:06.616472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-503e7208-fa85-416d-9d19-f5000bd23859 req-d3948aab-78b4-4285-a64e-047140e62ccf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:06.617039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-503e7208-fa85-416d-9d19-f5000bd23859 req-d3948aab-78b4-4285-a64e-047140e62ccf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:06.629142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-503e7208-fa85-416d-9d19-f5000bd23859 req-d3948aab-78b4-4285-a64e-047140e62ccf service nova] Creating event network-vif-plugged:1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77 for instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 on hv-cinder-85944 Sep 28 07:32:06.634339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-503e7208-fa85-416d-9d19-f5000bd23859 req-d3948aab-78b4-4285-a64e-047140e62ccf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 Sep 28 07:32:06.635168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 385/794] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:07.453545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:07.454160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:07.461258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:07.461750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:07.462180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:07.462877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:07.463328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:07.463747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:07.466793 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:07.775621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:07.783557 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a67dcea-4f6d-455f-bad2-f898db819e4e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1365 microversion: 2.1 time: 0.333850 Sep 28 07:32:07.785187 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 410/795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:07 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:08.814912 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:08.817307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:08.821650 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=6 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:08.829844 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:08.830929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:08.831674 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:08.832585 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:08.833315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:08.834151 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:09.028344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:09.038380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-508c0c1e-76fa-4893-a785-8c26129dba43 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1554 microversion: 2.1 time: 0.234168 Sep 28 07:32:09.039642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 386/796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:08 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:09.059013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:09.060097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:09.065458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:09.066026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:09.090204 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:09.090694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:09.091126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:09.091830 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:09.098737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:09.099382 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:09.230103 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7fdbf9d7-2e28-4f58-9590-caa4c2b3fed2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171848 Sep 28 07:32:09.243026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 411/797] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:32:09 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:10.259357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-68ccfe9f-8627-4dec-b71d-e7f899a0eafe req-9b845d98-25af-46a8-bb1b-8b9716eefe3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51bdb550-a2f4-43b5-a5b6-7faed7ef7be5", "tag": "1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:10.270371 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-68ccfe9f-8627-4dec-b71d-e7f899a0eafe req-9b845d98-25af-46a8-bb1b-8b9716eefe3b service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:10.270850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-68ccfe9f-8627-4dec-b71d-e7f899a0eafe req-9b845d98-25af-46a8-bb1b-8b9716eefe3b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:10.271443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-68ccfe9f-8627-4dec-b71d-e7f899a0eafe req-9b845d98-25af-46a8-bb1b-8b9716eefe3b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:10.275640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:10.285823 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-68ccfe9f-8627-4dec-b71d-e7f899a0eafe req-9b845d98-25af-46a8-bb1b-8b9716eefe3b service nova] Creating event network-changed:1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77 for instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 on hv-cinder-85944 Sep 28 07:32:10.291310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-68ccfe9f-8627-4dec-b71d-e7f899a0eafe req-9b845d98-25af-46a8-bb1b-8b9716eefe3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035523 Sep 28 07:32:10.292099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 387/798] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:11.229896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1499b5be-27bf-44a3-92bb-5c2822195e6f tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Action: 'create', calling method: .version_select at 0x7fa86228c9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-23275719", "metadata": {"Type": "work"}}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:11.547593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1499b5be-27bf-44a3-92bb-5c2822195e6f tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.486465 Sep 28 07:32:11.548341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 412/799] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 07:32:11 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 488 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 07:32:11.563733 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8d5c2058-0262-4b7c-ad4b-d5197c90c641 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Calling method '.version_select at 0x7fa861cfaf70>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:11.623893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8d5c2058-0262-4b7c-ad4b-d5197c90c641 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c" status: 200 len: 351 microversion: 2.1 time: 0.065670 Sep 28 07:32:11.624484 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 388/800] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:32:11 2022] GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:12.061604 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.063730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:12.072158 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:12.072638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:12.073125 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:12.073829 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:12.074279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:12.074697 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:12.103495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-77b7ed6b-fdc5-4ad6-ade1-f58e790e68e2 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046142 Sep 28 07:32:12.104045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 413/801] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 07:32:12 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:12.170784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.171409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:12.177588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:12.178074 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:12.178510 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:12.179199 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:12.179653 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:12.180076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:12.205253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:32:12.280532 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-48ed8279-c902-419b-8b85-a81a540a0986 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 204 len: 0 microversion: 2.20 time: 0.113236 Sep 28 07:32:12.281343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 389/802] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 07:32:12 2022] DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 07:32:12.289804 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.290406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:12.296219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:12.296691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:12.297165 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:12.297863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:12.298308 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:12.298723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:12.426755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:12.434762 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:12.436469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:12.437638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-80d9806f-8a17-4e95-8d62-b4c0eeb1c419 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.151815 Sep 28 07:32:12.438198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 414/803] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:12 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:32:12.638489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e832c37f-bf07-4970-8c1f-bcd218accc54 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Calling method '.version_select at 0x7fa861db6550>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.685142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e832c37f-bf07-4970-8c1f-bcd218accc54 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c" status: 200 len: 352 microversion: 2.1 time: 0.050825 Sep 28 07:32:12.685695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 390/804] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:32:12 2022] GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:32:12.699232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-83df8d6b-b142-4a04-8257-9f5cc7db3e8a tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Calling method '.version_select at 0x7fa86574bd30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.745897 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-83df8d6b-b142-4a04-8257-9f5cc7db3e8a tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c" status: 200 len: 352 microversion: 2.1 time: 0.050412 Sep 28 07:32:12.746465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 415/805] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:32:12 2022] GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:12.764118 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a12ddbe9-82f3-4ee3-8ade-c154bdf2a66f tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Calling method '.version_select at 0x7fa861e61c10>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.828673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a12ddbe9-82f3-4ee3-8ade-c154bdf2a66f tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c" status: 202 len: 0 microversion: 2.1 time: 0.068286 Sep 28 07:32:12.829274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 391/806] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:32:12 2022] DELETE /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:32:12.838282 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2b27479a-11c6-4e41-941c-ab874f61f65c tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Calling method '.version_select at 0x7fa865739dc0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:12.886001 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2b27479a-11c6-4e41-941c-ab874f61f65c tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c" status: 200 len: 351 microversion: 2.1 time: 0.051499 Sep 28 07:32:12.886575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 416/807] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:32:12 2022] GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:13.463428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:13.464163 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:13.470399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:13.470887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:13.471815 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:13.472513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:13.472990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:13.473421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:13.601472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:13.609731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:13.611204 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:13.612889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-20cad7ce-4604-4df2-9216-b07594445696 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1723 microversion: 2.20 time: 0.152907 Sep 28 07:32:13.613493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 392/808] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:13 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:32:13.901899 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d2afe70-bd55-4de9-b82f-50cb3ac8af30 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Calling method '.version_select at 0x7fa865762af0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:13.932324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5d2afe70-bd55-4de9-b82f-50cb3ac8af30 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] HTTP exception thrown: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d2afe70-bd55-4de9-b82f-50cb3ac8af30 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Request method failure captured: Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c HTTP/1.1 Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_h6C-_woieHtKXlM-DbNHUTTiPDkunrQJLab3Ewn1xY7rlA8nZ34Y1ENO-2x8-eoqrO6WMIAoNqAg0NpviZLfvSaXJwmGDq3NAaKbX_MyfxETDIxo3GGqL3L9IMMJtjfz0eb-fUdf3lGLy8HT5oLPcJCVgXGBlQkWcjA_kIg8KZTxs Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: d7dbaee9c6f24c12b6113473f42cf134 Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesGetTestJSON-464719636 Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:13.934332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7dbaee9c6f24c12b6113473f42cf134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d7dbaee9c6f24c12b6113473f42cf134"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d7dbaee9c6f24c12b6113473f42cf134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d7dbaee9c6f24c12b6113473f42cf134", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesGetTestJSON-464719636 Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: d7dbaee9c6f24c12b6113473f42cf134 Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesGetTestJSON-464719636 Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesGetTestJSON-464719636-project Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 62e2c7b6c2494b28b80bb2da789a0f61 Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesGetTestJSON-464719636-project Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '5d2c3946-106a-4e63-a373-62994802844c'} Sep 28 07:32:13.935937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. (HTTP 404) (Request-ID: req-3dfeacca-f39c-4197-b426-1b4b6df5fe76) Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:13.937247 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:32:13.939114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 07:32:13.940597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d2afe70-bd55-4de9-b82f-50cb3ac8af30 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] Returning 404 to user: Volume 5d2c3946-106a-4e63-a373-62994802844c could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d2afe70-bd55-4de9-b82f-50cb3ac8af30 tempest-VolumesGetTestJSON-464719636 tempest-VolumesGetTestJSON-464719636-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c" status: 404 len: 109 microversion: 2.1 time: 0.039072 Sep 28 07:32:13.942197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 417/809] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:32:13 2022] GET /compute/v2.1/os-volumes/5d2c3946-106a-4e63-a373-62994802844c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:32:14.640535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:14.641245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:14.654123 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:14.655091 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:14.656367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:14.657600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:14.658232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:14.658866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:14.810768 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:14.823953 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:14.826007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:14.827834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c1b58073-cd42-4ee0-841b-96b40a7cef96 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1655 microversion: 2.20 time: 0.193481 Sep 28 07:32:14.841084 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 393/810] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:14 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1655 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:32:15.079928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-25cdcd6e-754f-4e17-8d64-31c5e2893308 req-3acded3f-7b85-4ef2-b13c-2f27eb3ad233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc79aa8-ba8d-4d91-be11-1866bb283ca5", "name": "network-vif-deleted", "tag": "c4b55222-9158-47be-a317-e5ecd809aee4"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:15.099510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-25cdcd6e-754f-4e17-8d64-31c5e2893308 req-3acded3f-7b85-4ef2-b13c-2f27eb3ad233 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:15.100774 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-25cdcd6e-754f-4e17-8d64-31c5e2893308 req-3acded3f-7b85-4ef2-b13c-2f27eb3ad233 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:15.101467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-25cdcd6e-754f-4e17-8d64-31c5e2893308 req-3acded3f-7b85-4ef2-b13c-2f27eb3ad233 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:15.117744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-25cdcd6e-754f-4e17-8d64-31c5e2893308 req-3acded3f-7b85-4ef2-b13c-2f27eb3ad233 service nova] Creating event network-vif-deleted:c4b55222-9158-47be-a317-e5ecd809aee4 for instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 on hv-cinder-85944 Sep 28 07:32:15.124112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-25cdcd6e-754f-4e17-8d64-31c5e2893308 req-3acded3f-7b85-4ef2-b13c-2f27eb3ad233 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047901 Sep 28 07:32:15.125463 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 418/811] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:15.855517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:15.856132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:15.862958 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:15.863435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:15.864090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:15.865021 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:15.865666 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:15.866272 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:15.902879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:15.903548 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:15.904303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:15.904864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lazy-loading 'fault' on Instance uuid dbc79aa8-ba8d-4d91-be11-1866bb283ca5 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:32:15.952118 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:15.961198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:15.962645 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '764cfe23613e4a97ba05f8bf0ed77ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60646ef7a4ad4eb1860952504092742d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:15.963788 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b88d2b60-1353-4245-b231-b39e7bd90979 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 200 len: 1371 microversion: 2.20 time: 0.112138 Sep 28 07:32:15.965174 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 394/812] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:15 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 07:32:16.991681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:16.992309 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:16.999637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:17.000154 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:17.000586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:17.001312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:17.001760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:17.002175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:17.019531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] HTTP exception thrown: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Request method failure captured: Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 HTTP/1.1 Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_ahU4l9AF4kI1WsaYAIlwV8cw-7g4mo7_BHbBEjPmK9flIBc9f1Smzat7Tla0245YHmiBZOAyWwa5yh1RWhCm-MqV6HVPN0wvUK-TliluJFoN9ie5Er65oz546lqeBVV25cDvgkaSLLtZT7G1nKDNpbKh97G_jhauKom6S0GMrFyRo Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:17.021193 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60646ef7a4ad4eb1860952504092742d", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 764cfe23613e4a97ba05f8bf0ed77ef1 Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:17.022892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'dbc79aa8-ba8d-4d91-be11-1866bb283ca5'} Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:17.023919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:17.025836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:17.027108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Returning 404 to user: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:17.027108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e3d7438-a24c-4f0b-bda9-a66b919152bd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 404 len: 111 microversion: 2.20 time: 0.035999 Sep 28 07:32:17.027108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 419/813] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:16 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:32:17.031551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d750f9ae-ba1f-44b0-9ba7-9175a4c7839f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '.version_select at 0x7fa861d4d310>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:17.051664 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d750f9ae-ba1f-44b0-9ba7-9175a4c7839f tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525533996" status: 204 len: 0 microversion: 2.20 time: 0.023735 Sep 28 07:32:17.052241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 395/814] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Sep 28 07:32:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525533996 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 07:32:18.822418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:18.822930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:18.829217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:18.829693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:18.830148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:18.831461 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:18.831903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:18.832312 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:18.845483 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] HTTP exception thrown: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Request method failure captured: Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 HTTP/1.1 Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_ahU4l9AF4kI1WsaYAIlwV8cw-7g4mo7_BHbBEjPmK9flIBc9f1Smzat7Tla0245YHmiBZOAyWwa5yh1RWhCm-MqV6HVPN0wvUK-TliluJFoN9ie5Er65oz546lqeBVV25cDvgkaSLLtZT7G1nKDNpbKh97G_jhauKom6S0GMrFyRo Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:18.847045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60646ef7a4ad4eb1860952504092742d", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 764cfe23613e4a97ba05f8bf0ed77ef1 Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.848709 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'dbc79aa8-ba8d-4d91-be11-1866bb283ca5'} Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:18.849646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.851091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.852859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Returning 404 to user: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:18.852859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-59c581b5-5844-4049-bef5-55bcde9ba87b tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 404 len: 111 microversion: 2.20 time: 0.029805 Sep 28 07:32:18.852859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 420/815] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 07:32:18 2022] DELETE /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:32:18.857395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:18.858004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: dbc79aa8-ba8d-4d91-be11-1866bb283ca5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:18.864490 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:18.864988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:18.865423 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:18.866109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:18.866559 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:18.866979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:18.882653 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] HTTP exception thrown: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Request method failure captured: Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 HTTP/1.1 Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_ahU4l9AF4kI1WsaYAIlwV8cw-7g4mo7_BHbBEjPmK9flIBc9f1Smzat7Tla0245YHmiBZOAyWwa5yh1RWhCm-MqV6HVPN0wvUK-TliluJFoN9ie5Er65oz546lqeBVV25cDvgkaSLLtZT7G1nKDNpbKh97G_jhauKom6S0GMrFyRo Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:32:18.884271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60646ef7a4ad4eb1860952504092742d", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 764cfe23613e4a97ba05f8bf0ed77ef1 Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.885917 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'dbc79aa8-ba8d-4d91-be11-1866bb283ca5'} Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:18.886909 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. Sep 28 07:32:18.888389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:18.889855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Returning 404 to user: Instance dbc79aa8-ba8d-4d91-be11-1866bb283ca5 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:18.889855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-cfbdffdf-bfdb-4bad-9e80-ab4c84945c63 tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5" status: 404 len: 111 microversion: 2.20 time: 0.032741 Sep 28 07:32:18.889855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 396/816] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:18 2022] GET /compute/v2.1/servers/dbc79aa8-ba8d-4d91-be11-1866bb283ca5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:32:20.037271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:20.037818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:20.043990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:20.044484 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:20.044902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:20.045607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:20.046057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:20.046477 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:20.060483 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] HTTP exception thrown: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Request method failure captured: Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 HTTP/1.1 Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_ahU4l9AF4kI1WsaYAIlwV8cw-7g4mo7_BHbBEjPmK9flIBc9f1Smzat7Tla0245YHmiBZOAyWwa5yh1RWhCm-MqV6HVPN0wvUK-TliluJFoN9ie5Er65oz546lqeBVV25cDvgkaSLLtZT7G1nKDNpbKh97G_jhauKom6S0GMrFyRo Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:32:20.062311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60646ef7a4ad4eb1860952504092742d", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 764cfe23613e4a97ba05f8bf0ed77ef1 Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.063987 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '85725e51-be6a-4dc2-9438-347c786282f0'} Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:20.064892 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.066726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.068428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Returning 404 to user: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:20.068428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4de270ed-f6cf-44a5-86da-979ffacb2f1a tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 404 len: 111 microversion: 2.20 time: 0.031096 Sep 28 07:32:20.068428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 421/817] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 07:32:20 2022] DELETE /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:32:20.074730 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:20.077201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] [instance: 85725e51-be6a-4dc2-9438-347c786282f0] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:20.084446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:20.084989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:20.085439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:20.086133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:20.086583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:20.087002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:20.101175 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] HTTP exception thrown: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Request method failure captured: Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 HTTP/1.1 Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_ahU4l9AF4kI1WsaYAIlwV8cw-7g4mo7_BHbBEjPmK9flIBc9f1Smzat7Tla0245YHmiBZOAyWwa5yh1RWhCm-MqV6HVPN0wvUK-TliluJFoN9ie5Er65oz546lqeBVV25cDvgkaSLLtZT7G1nKDNpbKh97G_jhauKom6S0GMrFyRo Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:32:20.102738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/60646ef7a4ad4eb1860952504092742d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_60646ef7a4ad4eb1860952504092742d", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 60646ef7a4ad4eb1860952504092742d Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-602954768 Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 764cfe23613e4a97ba05f8bf0ed77ef1 Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeShelveTestJSON-602954768-project Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.104116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '85725e51-be6a-4dc2-9438-347c786282f0'} Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:32:20.105726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. Sep 28 07:32:20.107077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:32:20.108571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] Returning 404 to user: Instance 85725e51-be6a-4dc2-9438-347c786282f0 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:32:20.108571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7bbcbe82-e650-4187-b9f8-6cf163496cfd tempest-AttachVolumeShelveTestJSON-602954768 tempest-AttachVolumeShelveTestJSON-602954768-project] 10.222.0.52 "GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0" status: 404 len: 111 microversion: 2.20 time: 0.034006 Sep 28 07:32:20.108571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 397/818] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 07:32:20 2022] GET /compute/v2.1/servers/85725e51-be6a-4dc2-9438-347c786282f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:32:49.655360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1918927045", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "networks": [{"uuid": "d99a020f-4a11-48ef-a136-1ebf1da1cb25"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:49.664603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=31 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:49.665279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=29 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:49.714028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] validate_networks() for [('d99a020f-4a11-48ef-a136-1ebf1da1cb25', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:32:50.056715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:32:50.057239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:32:50.057711 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:32:50.058112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:32:50.058515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:32:50.073924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:50.074547 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:50.074982 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:50.075760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:50.076214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:50.076687 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:50.094570 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Getting quotas for project 01b7cf3a259443a9a370b79e2bc43dcc. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:32:50.099186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Getting quotas for user a5433685dfeb41abaf7c58758390ad9b and project 01b7cf3a259443a9a370b79e2bc43dcc. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:32:50.110610 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:32:50.113057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:32:50.163639 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-25fe45d7-4ffb-4626-b328-1c13a6cf4745 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511231 Sep 28 07:32:50.169369 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 422/819] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:32:50.175595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-494c74cb-6d32-4b47-b227-6744d2274483 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:50.176315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-494c74cb-6d32-4b47-b227-6744d2274483 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:50.180451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:50.181104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:32:50.250219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-494c74cb-6d32-4b47-b227-6744d2274483 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:50.258101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-494c74cb-6d32-4b47-b227-6744d2274483 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1214 microversion: 2.1 time: 0.086697 Sep 28 07:32:50.258989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 398/820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:50 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:51.281452 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:51.282071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:51.288380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:51.288860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:51.289326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:51.290008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:51.290468 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:51.290889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:51.354304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:51.362601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-118feff0-4910-4981-82a4-d062ea9530a2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1266 microversion: 2.1 time: 0.085678 Sep 28 07:32:51.363439 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 423/821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:51 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:52.386635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:52.387215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:52.394284 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:52.394766 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:52.395195 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:52.395877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:52.396328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:52.396743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:52.629580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:52.637274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-812c5173-00c1-4937-b038-115c73ef1709 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1314 microversion: 2.1 time: 0.254596 Sep 28 07:32:52.638176 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 399/822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:52 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:52.866956 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-f3d339a3-58f4-44df-b611-d1c50cfd0d4f req-22f5af5e-2531-4beb-8656-b206dd9859bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c891e4bf-23a6-4b51-a75d-7304c73254df", "tag": "64bbfb5d-9316-4ba8-a514-a2c205e42a92"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:52.883121 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f3d339a3-58f4-44df-b611-d1c50cfd0d4f req-22f5af5e-2531-4beb-8656-b206dd9859bf service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:52.883743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f3d339a3-58f4-44df-b611-d1c50cfd0d4f req-22f5af5e-2531-4beb-8656-b206dd9859bf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:52.884302 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-f3d339a3-58f4-44df-b611-d1c50cfd0d4f req-22f5af5e-2531-4beb-8656-b206dd9859bf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:52.899313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-f3d339a3-58f4-44df-b611-d1c50cfd0d4f req-22f5af5e-2531-4beb-8656-b206dd9859bf service nova] Creating event network-changed:64bbfb5d-9316-4ba8-a514-a2c205e42a92 for instance c891e4bf-23a6-4b51-a75d-7304c73254df on hv-cinder-85944 Sep 28 07:32:52.904579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-f3d339a3-58f4-44df-b611-d1c50cfd0d4f req-22f5af5e-2531-4beb-8656-b206dd9859bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041294 Sep 28 07:32:52.905207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 424/823] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:32:53.661029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:53.661675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:53.668181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:53.668726 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:53.669390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:53.670100 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:53.670714 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:53.671142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:53.853359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:53.861096 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e1ae9f61-3c9e-4d7f-9560-1fd10bca222a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1314 microversion: 2.1 time: 0.204354 Sep 28 07:32:53.862277 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 400/824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:53 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:54.888327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:54.889852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:54.896982 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:54.897823 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:54.898508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:54.899519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:54.900179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:54.901180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:55.053366 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:55.061182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b8d460e-7625-46ad-a752-d42a58a7954a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1314 microversion: 2.1 time: 0.176932 Sep 28 07:32:55.061743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 425/825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:54 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:56.085166 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:56.085809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:56.087819 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 07:32:56.087961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Wed Sep 28 07:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df (ip 10.222.0.52) !!! Sep 28 07:32:56.094159 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:56.094635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:56.095065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:56.095756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:56.096204 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:56.097351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:56.225233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:56.233127 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3000a40b-a752-4d60-a3c0-ce96f157536a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1314 microversion: 2.1 time: 0.152334 Sep 28 07:32:56.233696 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 401/826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:56 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:56.868486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-285ac43b-e92c-40e6-b1cd-c2ca6b652f68 req-98e06a7d-276b-4e42-a006-46442cf6c374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c891e4bf-23a6-4b51-a75d-7304c73254df", "name": "network-vif-plugged", "status": "completed", "tag": "64bbfb5d-9316-4ba8-a514-a2c205e42a92"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:32:56.875996 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 07:32:56.876159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Wed Sep 28 07:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 28 07:32:56.889985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-285ac43b-e92c-40e6-b1cd-c2ca6b652f68 req-98e06a7d-276b-4e42-a006-46442cf6c374 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:56.890465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-285ac43b-e92c-40e6-b1cd-c2ca6b652f68 req-98e06a7d-276b-4e42-a006-46442cf6c374 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:56.890958 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-285ac43b-e92c-40e6-b1cd-c2ca6b652f68 req-98e06a7d-276b-4e42-a006-46442cf6c374 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:56.903887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-285ac43b-e92c-40e6-b1cd-c2ca6b652f68 req-98e06a7d-276b-4e42-a006-46442cf6c374 service nova] Creating event network-vif-plugged:64bbfb5d-9316-4ba8-a514-a2c205e42a92 for instance c891e4bf-23a6-4b51-a75d-7304c73254df on hv-cinder-85944 Sep 28 07:32:56.908835 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-285ac43b-e92c-40e6-b1cd-c2ca6b652f68 req-98e06a7d-276b-4e42-a006-46442cf6c374 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044019 Sep 28 07:32:56.913109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 426/827] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:32:57.256381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:57.257083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:57.263547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:57.264019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:57.264444 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:57.265156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:57.265606 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:57.266018 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:57.390462 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:57.398133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-296184b1-2573-420e-a01a-20f53f0da001 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1314 microversion: 2.1 time: 0.146363 Sep 28 07:32:57.398682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 402/828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:57 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:58.422536 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:58.423376 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:58.430445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:58.431016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:58.431448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:58.432135 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:58.432584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:58.433026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:58.576152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:58.584354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d14aaca9-f008-4e33-9380-bd6a29875b6c tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1314 microversion: 2.1 time: 0.166906 Sep 28 07:32:58.585210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 427/829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:58 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:59.446951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:59.447566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:59.454317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:59.454898 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:59.455416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:59.456169 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:59.456686 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:59.457201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:59.483713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:32:59.562571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-eeb0b7ec-c257-4913-83df-c00d4a2abc84 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 204 len: 0 microversion: 2.1 time: 0.119673 Sep 28 07:32:59.564016 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 403/830] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:32:59 2022] DELETE /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:32:59.573488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:59.574818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:59.582856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:59.583328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:59.583754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:59.584447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:59.584902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:59.585404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:59.609457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:32:59.610519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:32:59.617368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:59.618084 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:59.618789 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:59.619485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:32:59.619931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:32:59.620351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:32:59.729072 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:59.737828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ee30697c-46cd-4a69-9802-1f5223cc977b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1577 microversion: 2.1 time: 0.169442 Sep 28 07:32:59.738505 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 428/831] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:59 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:32:59.806705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:32:59.814591 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-69ef6deb-a501-45bf-acfb-41fad01255ee tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1498 microversion: 2.1 time: 0.210901 Sep 28 07:32:59.815155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 404/832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:32:59 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:00.344603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:00.345016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:00.347506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:00.348180 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:00.354545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:00.355031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:00.355498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:00.356177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:00.356626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:00.357072 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:00.389197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:33:00.467142 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b4854fd9-a0a3-45c9-80cb-d29b17c36191 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 204 len: 0 microversion: 2.1 time: 0.126404 Sep 28 07:33:00.467818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 429/833] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:33:00 2022] DELETE /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:33:00.477699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:00.478314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:00.480366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:00.486894 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:00.487573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:00.488323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:00.489071 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:00.489535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:00.489969 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:00.632377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:00.640006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c2e53119-8dc8-4bb7-8a72-070cf1b4f50b tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1504 microversion: 2.1 time: 0.166790 Sep 28 07:33:00.640566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 405/834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:00 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:00.762461 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:00.763148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:00.770220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:00.770691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:00.771306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:00.771985 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:00.772429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:00.772842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:00.905236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:00.915161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1419767c-37ec-4dcc-b7c7-b8fedaa55656 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1577 microversion: 2.1 time: 0.156795 Sep 28 07:33:00.915735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 430/835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:00 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:01.664247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:01.664856 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:01.671303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:01.671915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:01.672342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:01.673116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:01.673567 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:01.674126 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:01.819441 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:01.827093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2a2c7b36-158c-4f78-97ae-bc9a26d609be tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1504 microversion: 2.1 time: 0.167656 Sep 28 07:33:01.827648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 406/836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:01 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:01.939702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:01.940224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:01.946334 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:01.946807 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:01.947233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:01.947896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:01.948342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:01.948751 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:02.083330 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:02.091004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b51f4382-f12f-4066-ab41-5c097ba8b49b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1577 microversion: 2.1 time: 0.155415 Sep 28 07:33:02.091568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 431/837] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:01 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:02.851153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:02.851765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:02.858197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:02.858682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:02.859123 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:02.859812 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:02.860271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:02.860693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:02.996516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:03.004620 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-28c3e9a3-6690-495b-9b58-386b7f716a18 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1504 microversion: 2.1 time: 0.158172 Sep 28 07:33:03.005213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 407/838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:02 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:03.115403 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:03.116022 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:03.122430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.122912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.123341 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.124033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.124488 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.124912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.257895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:03.265499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a1bbb05-391d-40c0-8a78-212db231e983 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1577 microversion: 2.1 time: 0.153984 Sep 28 07:33:03.266218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 432/839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:03 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:03.560662 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:03.561179 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:03.567993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.568470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.569121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.569800 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.570247 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.570661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.593831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9e0e9ede-a80d-4649-95cf-37f31f43077f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/ips" status: 200 len: 148 microversion: 2.1 time: 0.037004 Sep 28 07:33:03.594408 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 408/840] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:33:03 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:03.605912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ab062fa-9232-429a-8b6e-6029bc10788e"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:03.608275 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:03.614967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.615448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.615872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.616560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.617033 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.617450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.703013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Invalid volume: volume 2ab062fa-9232-429a-8b6e-6029bc10788e is already attached to instances: a6d19308-3fa5-46ed-b637-39d895095aed Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/os-volume_attachments HTTP/1.1 Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 74 Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:33:03.704724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {"volumeAttachment": {"volumeId": "2ab062fa-9232-429a-8b6e-6029bc10788e"}} Sep 28 07:33:03.706385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Invalid volume: volume 2ab062fa-9232-429a-8b6e-6029bc10788e is already attached to instances: a6d19308-3fa5-46ed-b637-39d895095aed Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'server_id': '51bdb550-a2f4-43b5-a5b6-7faed7ef7be5', 'body': {'volumeAttachment': {'volumeId': '2ab062fa-9232-429a-8b6e-6029bc10788e'}}} Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ab062fa-9232-429a-8b6e-6029bc10788e is already attached to instances: a6d19308-3fa5-46ed-b637-39d895095aed Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:03.710606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ab062fa-9232-429a-8b6e-6029bc10788e is already attached to instances: a6d19308-3fa5-46ed-b637-39d895095aed Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:03.712358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ab062fa-9232-429a-8b6e-6029bc10788e is already attached to instances: a6d19308-3fa5-46ed-b637-39d895095aed Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 400 to user: Invalid volume: volume 2ab062fa-9232-429a-8b6e-6029bc10788e is already attached to instances: a6d19308-3fa5-46ed-b637-39d895095aed {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-34fdea1a-4af2-45d2-9c06-005bf19726c6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104279 Sep 28 07:33:03.713893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 433/841] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:33:03 2022] POST /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:33:03.717397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:03.717966 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:03.724609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.725117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.725549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.726246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.726695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.727115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.752456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:33:03.834810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-be92d3ac-fa67-4311-94e1-3158d6a58c9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 204 len: 0 microversion: 2.1 time: 0.122675 Sep 28 07:33:03.837266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 409/842] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:33:03 2022] DELETE /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:33:03.845008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:03.845576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:03.853768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.854245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.854870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.855590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:03.856005 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:03.856462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:03.995789 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:04.004918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-974d1fa7-9104-4c35-9c88-7938154eed90 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1678 microversion: 2.1 time: 0.164098 Sep 28 07:33:04.005746 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 434/843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:03 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:04.028219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:04.029681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:04.036910 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:04.037608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:04.038258 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:04.039317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:04.039908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:04.040501 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:04.290102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:04.290692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:04.297221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:04.297936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:04.298367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:04.299112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:04.299574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:04.299990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:04.356087 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:04.365227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3c7b19c4-9299-4575-99de-1e881762f261 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1462 microversion: 2.1 time: 0.341141 Sep 28 07:33:04.365904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 410/844] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:04 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1462 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:04.416640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-fb66ad13-8f96-4a7a-972d-831de53710cf req-cf2ac954-954e-4ebb-bc38-832e01f95f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c891e4bf-23a6-4b51-a75d-7304c73254df", "name": "network-vif-deleted", "tag": "64bbfb5d-9316-4ba8-a514-a2c205e42a92"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:04.428062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-fb66ad13-8f96-4a7a-972d-831de53710cf req-cf2ac954-954e-4ebb-bc38-832e01f95f5b service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:04.428776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-fb66ad13-8f96-4a7a-972d-831de53710cf req-cf2ac954-954e-4ebb-bc38-832e01f95f5b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:04.429403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-fb66ad13-8f96-4a7a-972d-831de53710cf req-cf2ac954-954e-4ebb-bc38-832e01f95f5b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:04.443022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-fb66ad13-8f96-4a7a-972d-831de53710cf req-cf2ac954-954e-4ebb-bc38-832e01f95f5b service nova] Creating event network-vif-deleted:64bbfb5d-9316-4ba8-a514-a2c205e42a92 for instance c891e4bf-23a6-4b51-a75d-7304c73254df on hv-cinder-85944 Sep 28 07:33:04.448621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-fb66ad13-8f96-4a7a-972d-831de53710cf req-cf2ac954-954e-4ebb-bc38-832e01f95f5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035764 Sep 28 07:33:04.449390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 411/845] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:04.508375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:04.516676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c6129d1f-29ee-4b11-89d3-c14420a56176 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1577 microversion: 2.1 time: 0.230406 Sep 28 07:33:04.517286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 435/846] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:04 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:05.032697 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:05.033390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:05.043180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.043923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.044813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.045863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.046552 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.047222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.202472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:05.212368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f878b06e-852f-4f3d-9c8a-755dffb87910 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1678 microversion: 2.1 time: 0.184309 Sep 28 07:33:05.213774 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 412/847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:05 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:05.390068 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:05.391778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:05.402411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.402983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.403430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.404222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.404991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.405744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.453371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.453858 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.454298 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.454744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lazy-loading 'fault' on Instance uuid c891e4bf-23a6-4b51-a75d-7304c73254df {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:33:05.503258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:05.513675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-66dcfd20-ebf4-4bc6-8082-6c857b1832d2 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 200 len: 1304 microversion: 2.1 time: 0.129012 Sep 28 07:33:05.530864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 436/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:05 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:05.542947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:05.543746 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:05.551378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.553098 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.553710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.554608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:05.555268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:05.555908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:05.563201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:05.655528 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:05.665827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d220dcb6-0d3f-4134-b79b-7a34218adbd3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 200 len: 1225 microversion: 2.1 time: 0.127187 Sep 28 07:33:05.666910 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 413/849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:05 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:06.238198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:06.238827 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:06.248223 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.248818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.249288 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.249993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.250450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.250967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.405350 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:06.415963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e245eec1-882d-4221-9a74-aa9e0f2bc587 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 200 len: 1678 microversion: 2.1 time: 0.183124 Sep 28 07:33:06.416613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 437/850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:06 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:06.477257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-1d06a3e2-e97a-4715-90c9-8209bc95230e req-f78fcda2-ab93-44e2-90a0-dbbe7ef86814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e62a15-55d5-43ca-a578-13300d349c53", "name": "network-vif-deleted", "tag": "c820c0dd-b904-418b-a64a-a70ba69e8c04"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:06.488804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-1d06a3e2-e97a-4715-90c9-8209bc95230e req-f78fcda2-ab93-44e2-90a0-dbbe7ef86814 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.489662 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-1d06a3e2-e97a-4715-90c9-8209bc95230e req-f78fcda2-ab93-44e2-90a0-dbbe7ef86814 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.490194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-1d06a3e2-e97a-4715-90c9-8209bc95230e req-f78fcda2-ab93-44e2-90a0-dbbe7ef86814 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.503357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-1d06a3e2-e97a-4715-90c9-8209bc95230e req-f78fcda2-ab93-44e2-90a0-dbbe7ef86814 service nova] Creating event network-vif-deleted:c820c0dd-b904-418b-a64a-a70ba69e8c04 for instance a4e62a15-55d5-43ca-a578-13300d349c53 on hv-cinder-85944 Sep 28 07:33:06.508549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-1d06a3e2-e97a-4715-90c9-8209bc95230e req-f78fcda2-ab93-44e2-90a0-dbbe7ef86814 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035376 Sep 28 07:33:06.509557 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 414/851] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:06.540221 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:06.540963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: c891e4bf-23a6-4b51-a75d-7304c73254df] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:06.547574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.548061 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.548492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.549220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.549715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.550308 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.566470 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] HTTP exception thrown: Instance c891e4bf-23a6-4b51-a75d-7304c73254df could not be found. Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Request method failure captured: Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df HTTP/1.1 Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_igeiFOsy1ohZ21yWJF2D2PUO4UvyF0qHEmfjLXmwgoUu13BuG8NgjkJpf2KH53w-wvFsdu52yzTEsvqzZ-2D9voYg4Q4vTv2e1xO4ddQAn_QC3cnr_Sikxxc6MZ2GVS0vb6uvXOC55Pf4-OYhRZFDHhPdyhw12Ts1swKAOokc8qBE Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 01b7cf3a259443a9a370b79e2bc43dcc Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesActionsTest-700417914 Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:33:06.568353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01b7cf3a259443a9a370b79e2bc43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01b7cf3a259443a9a370b79e2bc43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01b7cf3a259443a9a370b79e2bc43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01b7cf3a259443a9a370b79e2bc43dcc", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesActionsTest-700417914 Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 01b7cf3a259443a9a370b79e2bc43dcc Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesActionsTest-700417914 Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesActionsTest-700417914-project Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: a5433685dfeb41abaf7c58758390ad9b Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesActionsTest-700417914-project Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance c891e4bf-23a6-4b51-a75d-7304c73254df could not be found. Sep 28 07:33:06.570434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'c891e4bf-23a6-4b51-a75d-7304c73254df'} Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c891e4bf-23a6-4b51-a75d-7304c73254df could not be found. Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:06.571388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c891e4bf-23a6-4b51-a75d-7304c73254df could not be found. Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c891e4bf-23a6-4b51-a75d-7304c73254df could not be found. Sep 28 07:33:06.572708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.581885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Returning 404 to user: Instance c891e4bf-23a6-4b51-a75d-7304c73254df could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:06.584571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef1b45fd-1112-4441-a137-95169680f495 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df" status: 404 len: 111 microversion: 2.1 time: 0.048727 Sep 28 07:33:06.586117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 438/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:06 2022] GET /compute/v2.1/servers/c891e4bf-23a6-4b51-a75d-7304c73254df => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:33:06.705493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:06.706895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:06.718611 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.719076 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.719549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.720350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:06.720815 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:06.721308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:06.765197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] HTTP exception thrown: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Request method failure captured: Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 HTTP/1.1 Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_fyvE8bE60pVbwV2bJg8r-JJ1NyG_2jrggmfg-MAKtKaHtnDZL7vx_8tC8haN8yPjV1ga70WSmOhEL-SB-qsl5wqbajmluyDnNFRqmpaLmzZ-pAKT1owQVAa9bbb7Nl45AX-YXiAMuFq9Udza2fxFXCcwSpPG4HokE8jqLy8z-8Sfs Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:33:06.766050 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfa33399f5994fb4a1ad804fa6e75f8b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 04cf365443b44d9d87338d95b5b0251b Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:33:06.767411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'a4e62a15-55d5-43ca-a578-13300d349c53'} Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:06.768168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:33:06.770211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:06.771765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Returning 404 to user: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:06.771765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-19264e36-e8db-4588-ba01-458530049abf tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 404 len: 111 microversion: 2.1 time: 0.079126 Sep 28 07:33:06.771765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 415/853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:06 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:33:06.781366 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1673109756", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "networks": [{"uuid": "d99a020f-4a11-48ef-a136-1ebf1da1cb25"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:06.925582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] validate_networks() for [('d99a020f-4a11-48ef-a136-1ebf1da1cb25', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:33:07.002111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1392156649", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1817965910", "security_groups": [{"name": "tempest-secgroup-smoke-401944427"}], "block_device_mapping_v2": [{"uuid": "7d8395d5-6523-4c3d-8461-cedcab9dea0e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3597cb55-79da-4b37-872b-aa28123264c5"}]}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:07.155377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] validate_networks() for [('3597cb55-79da-4b37-872b-aa28123264c5', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:33:07.384044 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:33:07.384655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:33:07.385161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:33:07.385563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:33:07.385980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:33:07.397705 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:07.398183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:07.398607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:07.399321 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:07.399947 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:07.400366 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:07.408109 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:07.425664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Getting quotas for project 01b7cf3a259443a9a370b79e2bc43dcc. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:33:07.432137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Getting quotas for user a5433685dfeb41abaf7c58758390ad9b and project 01b7cf3a259443a9a370b79e2bc43dcc. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:33:07.453924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:33:07.457451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:33:07.523144 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b23ba373-bd06-487a-937e-0626904e2b68 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755958 Sep 28 07:33:07.523845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 439/854] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 07:33:07.529170 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:07.530048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:07.537935 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:07.538418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:07.539010 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:07.539980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:07.540424 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:07.541088 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:07.559502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 HTTP/1.1 Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:33:07.561243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:33:07.562845 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '51bdb550-a2f4-43b5-a5b6-7faed7ef7be5'} Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:07.563591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:33:07.564798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:07.567963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:07.568798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-49590936-339a-45a4-873a-cef1247d284a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 404 len: 111 microversion: 2.1 time: 0.043745 Sep 28 07:33:07.569374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 440/855] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:07 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:33:07.573989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-efeb4a03-f05b-4088-8542-d1897c6048e5 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:07.575071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-efeb4a03-f05b-4088-8542-d1897c6048e5 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:07.628523 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-efeb4a03-f05b-4088-8542-d1897c6048e5 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:07.636014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-efeb4a03-f05b-4088-8542-d1897c6048e5 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1214 microversion: 2.1 time: 0.065470 Sep 28 07:33:07.636836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 441/856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:07 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:07.641875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a36c576a-6d03-4837-ae8d-94973ff05501 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '.version_select at 0x7fa8657873a0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:07.661180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:33:07.662335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:33:07.662811 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:33:07.663213 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:33:07.663778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:33:07.677756 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:07.678234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:07.678812 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a36c576a-6d03-4837-ae8d-94973ff05501 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896323644" status: 202 len: 0 microversion: 2.1 time: 0.039243 Sep 28 07:33:07.679399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 442/857] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 07:33:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896323644 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:33:07.679992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:07.680830 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:07.681360 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:07.681743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:07.700679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:33:07.705387 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for user 04cf365443b44d9d87338d95b5b0251b and project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:33:07.776794 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:33:07.779289 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d8395d5-6523-4c3d-8461-cedcab9dea0e',volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:33:08.005598 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4facf27f-2362-473a-b8b0-6cd8cdd2a3fb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007489 Sep 28 07:33:08.006272 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 416/858] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:33:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 07:33:08.019260 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-92e5b0af-9a25-47fb-b0a9-1ffd98e68a2c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:08.020202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-92e5b0af-9a25-47fb-b0a9-1ffd98e68a2c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:08.125236 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-567955204", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:08.144679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-92e5b0af-9a25-47fb-b0a9-1ffd98e68a2c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:08.156674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-92e5b0af-9a25-47fb-b0a9-1ffd98e68a2c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1095 microversion: 2.1 time: 0.142806 Sep 28 07:33:08.157631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 443/859] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:08 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1095 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:08.200010 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] validate_networks() for None {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:33:08.537419 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-d5d127c8-f183-41d8-9360-edb53b065f27 req-19165299-6524-4516-a99c-cb4e9206958b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51bdb550-a2f4-43b5-a5b6-7faed7ef7be5", "name": "network-vif-deleted", "tag": "1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:08.558490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d5d127c8-f183-41d8-9360-edb53b065f27 req-19165299-6524-4516-a99c-cb4e9206958b service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.559261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d5d127c8-f183-41d8-9360-edb53b065f27 req-19165299-6524-4516-a99c-cb4e9206958b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.560154 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-d5d127c8-f183-41d8-9360-edb53b065f27 req-19165299-6524-4516-a99c-cb4e9206958b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.575279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-d5d127c8-f183-41d8-9360-edb53b065f27 req-19165299-6524-4516-a99c-cb4e9206958b service nova] Creating event network-vif-deleted:1b44fc8c-3a1f-4b00-91da-0acdc2aa9b77 for instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 on hv-cinder-85944 Sep 28 07:33:08.582552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-d5d127c8-f183-41d8-9360-edb53b065f27 req-19165299-6524-4516-a99c-cb4e9206958b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050192 Sep 28 07:33:08.583707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 444/860] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:08.633243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:33:08.633665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:33:08.634136 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:33:08.648221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:33:08.648893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:33:08.656372 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:08.657233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:08.660509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.661163 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.661860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.662607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.663057 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.663648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.664196 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.664870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.665495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.666574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.667559 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.668173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.681922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Getting quotas for project f5a7235827c243c9828ebca72e47c156. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:33:08.685665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Getting quotas for user 691641e056634995888c88395d0fb47f and project f5a7235827c243c9828ebca72e47c156. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:33:08.697015 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:33:08.699102 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:33:08.749150 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c0f23c4b-ee44-456f-8c7c-2bd34163499d tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627568 Sep 28 07:33:08.749809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 417/861] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:33:08.757456 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:08.758075 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:08.764370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.764845 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.765357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lazy-loading 'services' on Instance uuid a6d19308-3fa5-46ed-b637-39d895095aed {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:33:08.766160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.767214 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.767675 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.768098 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.835487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:08.848538 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-40c27b3c-f481-487e-b112-e9bf106f9e35 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1266 microversion: 2.1 time: 0.097466 Sep 28 07:33:08.849232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 418/862] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:08 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:08.854356 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a8b3b179-a952-427b-adb1-b8fce2691881 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:08.855189 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a8b3b179-a952-427b-adb1-b8fce2691881 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:08.863323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-19bc509f-8793-493a-b56f-a6b20ecbcc52 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments/2ab062fa-9232-429a-8b6e-6029bc10788e" status: 202 len: 0 microversion: 2.1 time: 0.210863 Sep 28 07:33:08.864390 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 445/863] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:33:08 2022] DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments/2ab062fa-9232-429a-8b6e-6029bc10788e => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 07:33:08.873768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:08.875991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:08.887393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.888293 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.888974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.890043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:08.890677 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:08.891325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:08.917595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a8b3b179-a952-427b-adb1-b8fce2691881 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:08.927640 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a8b3b179-a952-427b-adb1-b8fce2691881 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1214 microversion: 2.1 time: 0.075722 Sep 28 07:33:08.928384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 419/864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:08 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:08.936126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1654b3b9-0796-4170-854d-ad009b5f1595 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067045 Sep 28 07:33:08.937423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 446/865] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:33:08 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:09.180812 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:09.181482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:09.187541 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.188024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.188458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.189170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.189623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.190043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.254515 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:09.263586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-caeff6dc-f440-4005-a74b-7ab4a5c75457 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1137 microversion: 2.1 time: 0.086503 Sep 28 07:33:09.264249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 420/866] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:09 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:09.874933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:09.875583 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:09.882726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.883205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.883635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.884318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.884764 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.885208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.951784 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:09.952335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:09.955212 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:09.963022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.963236 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c98d5056-943c-4f14-ad9f-1d322c6d3365 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1272 microversion: 2.1 time: 0.091865 Sep 28 07:33:09.963728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 447/867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:09 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:09.964104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.964718 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.965462 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.965919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.966369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.968207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:09.968978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:09.974922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.975405 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.975833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:09.976511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:09.977148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:09.977723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.014622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9b214f7b-59b7-4d4c-bbfd-c2bd08b53d2e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067194 Sep 28 07:33:10.015117 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 421/868] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:33:09 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 07:33:10.043953 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:10.053839 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4236dadf-7cf2-4a19-8a43-c5b3de00c972 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1210 microversion: 2.1 time: 0.089085 Sep 28 07:33:10.070496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 448/869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:09 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:10.164528 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:10.165155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:10.179877 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.180677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.181536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.182416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.183104 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.183546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.231624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:33:10.297465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:10.298688 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:10.323871 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.326679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.329706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.330858 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.333443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.334450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.340986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:10.351253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-622120a6-395a-41ed-af2a-962807185483 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 204 len: 0 microversion: 2.1 time: 0.188832 Sep 28 07:33:10.357748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 422/870] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:33:10 2022] DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:33:10.365731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:10.366472 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:10.375713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.377220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.377826 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.379669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.380270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.380753 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.418558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:10.428687 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6de44dd6-d1e4-441e-916c-9a9edb7b6f14 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1211 microversion: 2.1 time: 0.143991 Sep 28 07:33:10.429389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 449/871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:10 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:10.645235 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:10.653154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ededdbc7-757a-48a6-a8e9-a92c2ec4a0ad tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1683 microversion: 2.1 time: 0.294079 Sep 28 07:33:10.653732 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 423/872] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:10 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1683 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:10.988009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:10.988738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:10.992349 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:10.996290 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.996775 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.997228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:10.997931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:10.998375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:10.998806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.079737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:11.080471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:11.087367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.088011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.088551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.089487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.089988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.090512 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.218544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:11.227526 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-4077847d-2cb7-48d4-bb73-45ea1363dbd1 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1266 microversion: 2.1 time: 0.151567 Sep 28 07:33:11.228274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 424/873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:11 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:11.364669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:11.372993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9476eb52-b79e-4989-b7a5-ceb20e6c8950 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.389097 Sep 28 07:33:11.373756 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 450/874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:10 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:11.378951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-3213fd45-1d8b-4048-be1b-95c92b93613e req-95ebbf78-3b4d-423e-ae40-0fc96fa3619f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237b8b2c-efde-4e5d-bb53-745c61a95783", "tag": "3a5dc0ae-1b9e-4e59-9e9c-f4dcfe5ebac9"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:11.388679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3213fd45-1d8b-4048-be1b-95c92b93613e req-95ebbf78-3b4d-423e-ae40-0fc96fa3619f service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.389199 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3213fd45-1d8b-4048-be1b-95c92b93613e req-95ebbf78-3b4d-423e-ae40-0fc96fa3619f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.389656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3213fd45-1d8b-4048-be1b-95c92b93613e req-95ebbf78-3b4d-423e-ae40-0fc96fa3619f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.402831 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-3213fd45-1d8b-4048-be1b-95c92b93613e req-95ebbf78-3b4d-423e-ae40-0fc96fa3619f service nova] Creating event network-changed:3a5dc0ae-1b9e-4e59-9e9c-f4dcfe5ebac9 for instance 237b8b2c-efde-4e5d-bb53-745c61a95783 on hv-cinder-85944 Sep 28 07:33:11.407476 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-3213fd45-1d8b-4048-be1b-95c92b93613e req-95ebbf78-3b4d-423e-ae40-0fc96fa3619f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032306 Sep 28 07:33:11.408057 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 425/875] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:11.452906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:11.453548 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:11.459629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.460112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.460552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.461275 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.461731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.462162 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.523362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:11.530882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-106541c2-879f-4507-b164-9c54f7573db5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1211 microversion: 2.1 time: 0.081835 Sep 28 07:33:11.531443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 451/876] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:11 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:11.678578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:11.679197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:11.685401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.685882 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.686346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.687038 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:11.687748 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:11.688173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:11.920278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:11.928055 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-72e55cb6-c032-4d8b-b6fd-908a0b42fdfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1683 microversion: 2.1 time: 0.254614 Sep 28 07:33:11.928682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 426/877] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:11 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:12.251492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:12.252233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:12.259515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.260108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.260602 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.262200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.262753 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.263248 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.347374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:12.356933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a3f27c4d-3249-4f52-a086-76be071ac371 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1266 microversion: 2.1 time: 0.109181 Sep 28 07:33:12.357834 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 452/878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:12 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:12.396655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:12.397400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:12.405932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.406689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.408133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.408884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.409499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.410434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.554815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:12.555648 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:12.561694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.562413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.562856 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.563541 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.564013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.564621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.626453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:12.634527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef7fd961-966c-4382-99ec-a0a5e95aaf36 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1199 microversion: 2.1 time: 0.083708 Sep 28 07:33:12.635095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 453/879] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:12 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:12.928388 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:12.936558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-edb9e90a-fc34-4e4a-aca2-59676b3f7415 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.544801 Sep 28 07:33:12.937555 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 427/880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:12 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:12.956897 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:12.957550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:12.963425 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.963905 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.964344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:12.965084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:12.965538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:12.966034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:13.106054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:13.114653 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f64ece0-4e46-4344-b8ab-9958f122a474 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1683 microversion: 2.1 time: 0.166843 Sep 28 07:33:13.115437 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 454/881] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:12 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:13.383573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:13.384276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:13.390991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:13.391479 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:13.392194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:13.392974 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:13.393425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:13.394006 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:13.552194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:13.559807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b3eeb6de-7ecb-42e7-94bf-2073d2849670 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1272 microversion: 2.1 time: 0.180298 Sep 28 07:33:13.560390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 428/882] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:13 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:13.657974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:13.658577 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:13.665731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:13.666226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:13.666634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:13.667416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:13.667887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:13.668446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:13.802531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:13.811035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7a7c2053-2d4b-4f4c-af4e-33344ab1ed80 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.156833 Sep 28 07:33:13.811610 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 455/883] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:13 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:13.962657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:13.963412 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:13.970376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:13.971391 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:13.972514 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:13.973373 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:13.973889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:13.974481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:14.140352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:14.141188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:14.148338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:14.148917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:14.149437 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:14.150201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:14.150722 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:14.151201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:14.219087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:14.227002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-26bed598-0696-41cc-a579-7d2660eb3d29 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1615 microversion: 2.1 time: 0.090848 Sep 28 07:33:14.227566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 456/884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:14 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:14.582643 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:14.583241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:14.589777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:14.590520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:14.591126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:14.591821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:14.592441 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:14.592881 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:14.653492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:14.661757 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-48c4cba9-406b-466a-bcab-769d3c0ea5dd tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1272 microversion: 2.1 time: 0.083330 Sep 28 07:33:14.663240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:14.672518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-79f07270-af44-4e94-afe2-f496d591cbec tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.716533 Sep 28 07:33:14.677959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 457/886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:14 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:14.678125 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 429/886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:13 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:14.834396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:14.835133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:14.841751 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:14.842359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:14.842895 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:14.843684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:14.844240 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:14.844768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.000555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:15.010396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2f140e04-33d4-4649-8ee6-c90da7108fc4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.180054 Sep 28 07:33:15.011081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 458/887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:14 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:15.251629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:15.254840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b7e05474-a618-4843-9935-b927b5f7fc22 req-bb02dae2-ceed-48c1-896f-9af246080517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d19308-3fa5-46ed-b637-39d895095aed", "name": "network-vif-deleted", "tag": "9761dab3-6f7c-4dc0-94df-407f871849f1"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:15.255035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:15.270706 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.273685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.274737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.275070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b7e05474-a618-4843-9935-b927b5f7fc22 req-bb02dae2-ceed-48c1-896f-9af246080517 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.275684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b7e05474-a618-4843-9935-b927b5f7fc22 req-bb02dae2-ceed-48c1-896f-9af246080517 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.276120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b7e05474-a618-4843-9935-b927b5f7fc22 req-bb02dae2-ceed-48c1-896f-9af246080517 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.276446 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.277196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.278022 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.312096 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b7e05474-a618-4843-9935-b927b5f7fc22 req-bb02dae2-ceed-48c1-896f-9af246080517 service nova] Creating event network-vif-deleted:9761dab3-6f7c-4dc0-94df-407f871849f1 for instance a6d19308-3fa5-46ed-b637-39d895095aed on hv-cinder-85944 Sep 28 07:33:15.319360 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b7e05474-a618-4843-9935-b927b5f7fc22 req-bb02dae2-ceed-48c1-896f-9af246080517 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068500 Sep 28 07:33:15.324179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 459/888] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:15.400581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:15.410245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f8ff4817-3599-4bc2-ae30-4278aa0abd46 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1615 microversion: 2.1 time: 0.162791 Sep 28 07:33:15.411619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 430/889] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:15 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1615 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:15.686134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:15.698817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:15.699389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:15.704433 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:15.709834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.710329 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.710767 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.713528 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.715263 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.715932 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.716226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.716793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.717279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.717626 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:15.719046 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:15.719731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:15.885656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:15.892437 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:15.906989 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-731d4e6b-789f-4932-8977-97ea0d29a5cb tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.224343 Sep 28 07:33:15.908928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 460/890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:15 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:16.035486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:16.036204 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:16.053795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.054326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.054763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:16.055465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.055918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.056335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:16.079975 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:16.094680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-75291d09-0c06-477d-99e5-fc37157538ce tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.400233 Sep 28 07:33:16.095915 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 431/891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:15 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:16.209867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:16.219162 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-474b4d59-e7de-428c-8e98-8af16d6dce97 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.188569 Sep 28 07:33:16.219775 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 461/892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:16 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:16.436359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:16.437072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:16.444783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.445312 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.445772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:16.446484 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.446931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.447347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:16.471270 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:16.488198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.488418 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.488807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:16.489280 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lazy-loading 'fault' on Instance uuid a6d19308-3fa5-46ed-b637-39d895095aed {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:33:16.538813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:16.547305 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5f2cbd20-4267-412e-9b3b-1d4bc5af4639 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 200 len: 1332 microversion: 2.1 time: 0.115071 Sep 28 07:33:16.548331 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 432/893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:16 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:16.931801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:16.932406 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:16.939344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.939840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.940844 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:16.941588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:16.942042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:16.942467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.078503 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:17.086734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bf76c27c-1abf-46d8-a40f-4a02d9399fba tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.158764 Sep 28 07:33:17.087458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 462/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:16 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:17.120234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:17.120907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:17.128370 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.128864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.129321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.130017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.130465 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.130883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.244178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:17.245667 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:17.253071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.253472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.253901 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.254596 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.255049 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.255463 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.344802 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:17.361533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-90d39382-b486-497b-80f7-5d19d66cf20f tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.243347 Sep 28 07:33:17.362808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 433/895] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:17 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:17.377191 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1499fdb-7b61-4c9e-81d3-09a649f4acab", "tag": "b8112591-d797-4e25-a5d4-e84683e0ddee"}, {"name": "network-changed", "server_uuid": "26de492c-9781-4f28-b23c-1106cdfa495a", "tag": "a42c2ccf-690d-4a83-9807-b8628743a710"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:17.398790 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.399539 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.400168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.408592 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:17.432192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] Creating event network-changed:b8112591-d797-4e25-a5d4-e84683e0ddee for instance f1499fdb-7b61-4c9e-81d3-09a649f4acab on hv-cinder-85944 Sep 28 07:33:17.437534 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] Creating event network-changed:a42c2ccf-690d-4a83-9807-b8628743a710 for instance 26de492c-9781-4f28-b23c-1106cdfa495a on hv-cinder-85944 Sep 28 07:33:17.455009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:17.464519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-2443e98f-a38a-4218-ac00-d7ba84017759 req-aa6eecc9-f933-4661-86d0-787fef0af949 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.098979 Sep 28 07:33:17.464939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-64958bc4-49a6-40e5-904a-f007bda7a3c3 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.224504 Sep 28 07:33:17.467009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 463/896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:17 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:17.467561 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 434/897] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:17.572556 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:17.573499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:17.579727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.580339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.580921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.582024 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:17.582514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:17.582963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:17.598487 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed HTTP/1.1 Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:33:17.600176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:33:17.601842 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'a6d19308-3fa5-46ed-b637-39d895095aed'} Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:17.606506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:33:17.608004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:17.609337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:17.609337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-143ef66b-f54a-43a5-9099-95547bfef1a5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 404 len: 111 microversion: 2.1 time: 0.032930 Sep 28 07:33:17.609337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 464/898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:17 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:33:17.610998 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7680d9ad-76e5-4232-a213-231b4ea61d55 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '.version_select at 0x7fa861cafe50>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:17.631779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7680d9ad-76e5-4232-a213-231b4ea61d55 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095849973" status: 202 len: 0 microversion: 2.1 time: 0.024839 Sep 28 07:33:17.632273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 435/899] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 07:33:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095849973 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:33:18.109827 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:18.110428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:18.117313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:18.117789 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:18.118225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:18.118896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:18.119338 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:18.119748 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:18.152070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=10 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:18.309860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-edf3f908-a7a6-427f-add2-147581cecd17 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: .version_select at 0x7fa861cfac10>, body: {"keypair": {"name": "tempest-keypair-1876371491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlxEeb3UBGJjkTblI1pg9d5UPqTE/Ak5/jc3/oOUWis/uMHRY6e8qrH1A2PCoMPsvSP9ssckXt9RW6iRTd1Gjq4ZR3Dya9/qg78EbT4/pPbvDEOr+d4/L1JJYiX6gAgcw=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:18.320043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:18.327061 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-edf3f908-a7a6-427f-add2-147581cecd17 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:33:18.327638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0a6894db-3e30-4c2f-8e40-38de54cba040 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.221584 Sep 28 07:33:18.328209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 465/900] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:18 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:18.331424 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-edf3f908-a7a6-427f-add2-147581cecd17 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:33:18.353347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-edf3f908-a7a6-427f-add2-147581cecd17 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047377 Sep 28 07:33:18.354034 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 436/901] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:33:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:18.386028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:18.386457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:18.392264 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:18.392745 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:18.393703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:18.394722 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:18.395184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:18.395609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:18.497893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:18.498747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:18.505269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:18.505975 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:18.506684 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:18.507581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:18.508180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:18.508687 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:18.527008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:18.536769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eb554633-1170-4ab6-b154-96a7c0584584 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.154789 Sep 28 07:33:18.537962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 466/902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:18 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:18.671197 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:18.788665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:18.799383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-913639d6-a56e-4964-8a4d-473cb0bbc395 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.311436 Sep 28 07:33:18.800258 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 437/903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:18 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:19.115232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-60ba16de-d778-46b3-bf5d-8d901eb8f00e req-915117e7-b4a5-436a-9e10-e5da68713d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237b8b2c-efde-4e5d-bb53-745c61a95783", "name": "network-vif-plugged", "status": "completed", "tag": "3a5dc0ae-1b9e-4e59-9e9c-f4dcfe5ebac9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:19.125673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60ba16de-d778-46b3-bf5d-8d901eb8f00e req-915117e7-b4a5-436a-9e10-e5da68713d28 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.126243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60ba16de-d778-46b3-bf5d-8d901eb8f00e req-915117e7-b4a5-436a-9e10-e5da68713d28 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.127021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-60ba16de-d778-46b3-bf5d-8d901eb8f00e req-915117e7-b4a5-436a-9e10-e5da68713d28 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.140863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-60ba16de-d778-46b3-bf5d-8d901eb8f00e req-915117e7-b4a5-436a-9e10-e5da68713d28 service nova] Creating event network-vif-plugged:3a5dc0ae-1b9e-4e59-9e9c-f4dcfe5ebac9 for instance 237b8b2c-efde-4e5d-bb53-745c61a95783 on hv-cinder-85944 Sep 28 07:33:19.146157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-60ba16de-d778-46b3-bf5d-8d901eb8f00e req-915117e7-b4a5-436a-9e10-e5da68713d28 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034661 Sep 28 07:33:19.146923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 467/904] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:19.351679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:19.352317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:19.359410 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.359898 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.360334 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.361271 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.362060 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.362643 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.563333 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:19.564345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:19.571616 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.572111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.572542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.573274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.573725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.574140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.775282 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:19.784642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-affe1afb-bbda-49b3-a67e-d68cb1ced92e tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.225816 Sep 28 07:33:19.792523 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 468/905] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:19 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:19.822864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:19.823738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:19.829763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.830375 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.831557 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.832453 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:19.833668 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:19.834208 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:19.867351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:19.875512 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5c62e782-50a3-4ccc-a5ff-fdcae49fe24a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.527887 Sep 28 07:33:19.876260 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 438/906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:19 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:20.061418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:20.069991 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef297233-5f01-4d00-ab77-295ac7717eec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.251028 Sep 28 07:33:20.071035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 469/907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:19 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:20.182011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1597870886", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "733608a5-23eb-466d-8629-abe8aafc7bed"}], "security_groups": [{"name": "tempest-securitygroup--1343922431"}], "key_name": "tempest-keypair-1876371491", "user_data": "}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:20.337578 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] validate_networks() for [('733608a5-23eb-466d-8629-abe8aafc7bed', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:33:20.711637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:33:20.712211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:33:20.712600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:33:20.713019 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:33:20.713434 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:33:20.722094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:20.722574 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:20.723009 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:20.723732 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:20.724186 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:20.724608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:20.741366 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:33:20.745304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:33:20.756716 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:33:20.759026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:33:20.808680 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1a237932-aef9-44bf-b229-20c509df35f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632327 Sep 28 07:33:20.809358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:20.817027 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 439/908] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:33:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:33:20.822582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d66be9ea-21fe-457d-8829-954670f5790b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:20.823355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d66be9ea-21fe-457d-8829-954670f5790b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:20.825738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:20.833268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:20.834490 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:20.835174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:20.836847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:20.837364 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:20.837770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:20.920035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d66be9ea-21fe-457d-8829-954670f5790b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:20.929989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d66be9ea-21fe-457d-8829-954670f5790b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1242 microversion: 2.1 time: 0.111571 Sep 28 07:33:20.930820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 440/909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:20 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:20.935740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:20.937249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:20.944371 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:20.945099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:20.945897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:20.948605 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:20.949093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:20.949527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:21.013003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:21.020919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8eb9662-dcb3-46f7-aa28-4b4c29cd6bf7 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1314 microversion: 2.1 time: 0.215668 Sep 28 07:33:21.021703 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 470/910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:20 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:21.093514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:21.094347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:21.102843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:21.103472 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:21.104205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:21.105602 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:21.110261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:21.110261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:21.113439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:21.121945 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-04e7df9c-7c41-4eef-9e44-8b9529d1fc92 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.190037 Sep 28 07:33:21.122652 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 441/911] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:20 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:21.181225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-8e515665-d948-47d3-86cf-5c7bd68151e0 req-11c3788d-12d7-4755-855d-647d495dc54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26de492c-9781-4f28-b23c-1106cdfa495a", "name": "network-vif-plugged", "status": "completed", "tag": "a42c2ccf-690d-4a83-9807-b8628743a710"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:21.193051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8e515665-d948-47d3-86cf-5c7bd68151e0 req-11c3788d-12d7-4755-855d-647d495dc54d service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:21.193459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8e515665-d948-47d3-86cf-5c7bd68151e0 req-11c3788d-12d7-4755-855d-647d495dc54d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:21.193888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8e515665-d948-47d3-86cf-5c7bd68151e0 req-11c3788d-12d7-4755-855d-647d495dc54d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:21.205414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-8e515665-d948-47d3-86cf-5c7bd68151e0 req-11c3788d-12d7-4755-855d-647d495dc54d service nova] Creating event network-vif-plugged:a42c2ccf-690d-4a83-9807-b8628743a710 for instance 26de492c-9781-4f28-b23c-1106cdfa495a on hv-cinder-85944 Sep 28 07:33:21.210453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-8e515665-d948-47d3-86cf-5c7bd68151e0 req-11c3788d-12d7-4755-855d-647d495dc54d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033545 Sep 28 07:33:21.211226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 442/912] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:21.254042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:21.262545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b8356ad5-4709-4b3e-b4ad-5197b34d102c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.172896 Sep 28 07:33:21.263123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 471/913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:21 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:21.952577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:21.953223 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:21.960341 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:21.960825 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:21.961296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:21.961983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:21.962435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:21.962891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.023512 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:22.031013 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-08f0168a-a8cb-4f69-aa3e-2740d21e00f0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1294 microversion: 2.1 time: 0.083255 Sep 28 07:33:22.031569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 443/914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:21 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:22.045095 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:22.045816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:22.052586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.053201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.053635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.054324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.054767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.055186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.143535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:22.144293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:22.150283 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.150763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.151196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.151954 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.152321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.152735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.185097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:22.193721 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-eebb28b2-cbc7-4b77-a3f4-22bd401d8ea0 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1499 microversion: 2.1 time: 0.152409 Sep 28 07:33:22.194380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 472/915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:22 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:22.283261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:22.286516 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:22.287118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:22.291241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1af1c272-e3f6-4390-a1ab-820fd1f4d16b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.151572 Sep 28 07:33:22.291842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 444/916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:22 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:22.292861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.293370 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.293814 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.294501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.294942 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.295356 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.588861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:22.596642 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-208428e2-b142-457c-b40e-17a85ff69ec7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.313725 Sep 28 07:33:22.597354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 473/917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:22 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:22.728765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:22.729292 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:22.735267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.735743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.736170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.737116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.737604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.738036 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.770923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:33:22.847333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1730b108-558d-4c53-a70a-20fe1aa71544 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "DELETE /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 204 len: 0 microversion: 2.1 time: 0.122386 Sep 28 07:33:22.847916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 445/918] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:33:22 2022] DELETE /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:33:22.855977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:22.856574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:22.863115 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.863615 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.864019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.864695 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:22.865170 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:22.865587 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:22.993612 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:23.001139 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dc074874-0749-4ff6-bc82-ae2668b04b41 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1505 microversion: 2.1 time: 0.148989 Sep 28 07:33:23.001684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 474/919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:22 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:23.055060 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:23.055763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:23.062124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:23.062852 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:23.063283 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:23.063965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:23.064415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:23.064834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:23.126070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:23.134786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a283458d-41cd-42f1-b657-24c812531bf4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1302 microversion: 2.1 time: 0.084043 Sep 28 07:33:23.135356 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 446/920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:23 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:23.314825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:23.315511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:23.321822 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:23.322301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:23.322731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:23.323410 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:23.323862 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:23.324281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:23.453354 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:23.460977 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f29fdac5-1ad7-4bc3-8b44-e5dce0e891bc tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1314 microversion: 2.1 time: 0.150211 Sep 28 07:33:23.461529 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 475/921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:23 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:23.619361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:23.619925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:23.625871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:23.626355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:23.626785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:23.627471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:23.627929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:23.628349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:23.825908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:23.833911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bb695b2e-9b8d-4411-aba9-b2c842bb5c5b tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.218460 Sep 28 07:33:23.834690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 447/922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:23 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:24.025015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:24.025631 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:24.031651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.032135 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.032590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.033294 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.033770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.034458 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.157837 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:24.158544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:24.162043 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:24.165452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.165942 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.166397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.167082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.167535 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.167963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.170168 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8df1daa2-924e-42f4-99ed-0b5fac4c424a tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1505 microversion: 2.1 time: 0.149061 Sep 28 07:33:24.170749 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 476/923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:24 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:24.237389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:24.244937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-470cf4a3-eb48-469d-8d5f-c85e990e4c7c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1302 microversion: 2.1 time: 0.091079 Sep 28 07:33:24.245518 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 448/924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:24 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:24.483897 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:24.484434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:24.491584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.492056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.492479 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.493174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.493621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.494040 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.628780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:24.636369 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d2211ef2-b475-4325-8bb9-94caa4c36b46 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1464 microversion: 2.1 time: 0.156375 Sep 28 07:33:24.636928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 477/925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:24 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:24.682700 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:24.683196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:24.689337 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.689818 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.690308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.691030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.691478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.691895 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.716533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:33:24.784307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:24.790327 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a8a0f824-ae32-47c9-b7e6-b5cf85a0b5ef tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 204 len: 0 microversion: 2.1 time: 0.111218 Sep 28 07:33:24.790896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 449/926] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:33:24 2022] DELETE /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:33:24.800911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:24.801566 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:24.807586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.808073 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.808506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.809232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.809685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.810107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.858011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:24.858889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:24.872002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.872826 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.872989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.874291 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:24.874934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:24.875381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:24.903263 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:24.955480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:24.962448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:24.965218 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8f5a566-4dec-4e9b-92aa-6f85d065605e tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1470 microversion: 2.1 time: 0.169955 Sep 28 07:33:24.966120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 478/927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:24 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:25.031360 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:25.039885 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a2893b2d-35d4-430d-be4f-52e6cc44c35f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.186272 Sep 28 07:33:25.040496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 450/928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:24 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:25.193872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:25.194474 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:25.200398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:25.200879 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:25.201334 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:25.202126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:25.202579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:25.202995 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:25.268846 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:25.269656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:25.276157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:25.276752 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:25.277294 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:25.278057 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:25.278586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:25.279081 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:25.333057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:25.341120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-faa3e3d6-dbac-4d9e-8045-08d0c7f3cc90 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1505 microversion: 2.1 time: 0.151058 Sep 28 07:33:25.341258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 479/929] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:25 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:25.343292 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:25.351951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-fbb312aa-a198-4704-a92d-f158e38fcdf6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1302 microversion: 2.1 time: 0.087494 Sep 28 07:33:25.352508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 451/930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:25 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:25.989200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:25.989736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:25.996029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:25.996590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:25.997108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:25.997816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:25.998272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:25.998693 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.063435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:26.064142 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:26.070842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.071406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.071845 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.072540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.073014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.073435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.132915 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:26.140593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-097f7dad-c67a-4d1a-bcdd-513c169d3540 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1470 microversion: 2.1 time: 0.156006 Sep 28 07:33:26.141191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 480/931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:25 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:26.204358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:26.212014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3b01408d-9d34-421b-a916-df5503e16977 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.152765 Sep 28 07:33:26.212569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 452/932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:26 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:26.365303 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:26.365898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:26.372124 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.372604 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.373058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.373736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.374216 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.374346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:26.374818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.374991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:26.381589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.382069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.382500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.383224 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.383672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.384090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.446695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:26.454404 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-404f3fd2-a3eb-4a86-94d2-aee9f64d830e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1300 microversion: 2.1 time: 0.084047 Sep 28 07:33:26.454972 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 453/933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:26 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:26.504311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:26.512012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bd52b29-6614-4e4d-b237-6fb3c49d83dd tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1505 microversion: 2.1 time: 0.151514 Sep 28 07:33:26.512595 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 481/934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:26 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:26.970317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-68c9deb8-97c8-43aa-b751-89832255a39e req-db4ffc4d-f783-4b97-9910-bedfc5cee1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1499fdb-7b61-4c9e-81d3-09a649f4acab", "name": "network-vif-plugged", "status": "completed", "tag": "b8112591-d797-4e25-a5d4-e84683e0ddee"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:26.980164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-68c9deb8-97c8-43aa-b751-89832255a39e req-db4ffc4d-f783-4b97-9910-bedfc5cee1d4 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:26.980627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-68c9deb8-97c8-43aa-b751-89832255a39e req-db4ffc4d-f783-4b97-9910-bedfc5cee1d4 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:26.981095 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-68c9deb8-97c8-43aa-b751-89832255a39e req-db4ffc4d-f783-4b97-9910-bedfc5cee1d4 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:26.992858 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-68c9deb8-97c8-43aa-b751-89832255a39e req-db4ffc4d-f783-4b97-9910-bedfc5cee1d4 service nova] Creating event network-vif-plugged:b8112591-d797-4e25-a5d4-e84683e0ddee for instance f1499fdb-7b61-4c9e-81d3-09a649f4acab on hv-cinder-85944 Sep 28 07:33:26.997732 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-68c9deb8-97c8-43aa-b751-89832255a39e req-db4ffc4d-f783-4b97-9910-bedfc5cee1d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031168 Sep 28 07:33:26.998315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 454/935] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:27.163081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:27.163613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:27.170012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.170485 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.170913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.171585 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.172047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.172461 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.235792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:27.236478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:27.243138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.243616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.244046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.244724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.245196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.245615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.302673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:27.310265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-700f189e-fc96-4ee9-906e-ff09f5fb2cc5 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1470 microversion: 2.1 time: 0.151168 Sep 28 07:33:27.311047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 482/936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:27 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:27.477690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:27.478294 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:27.482517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:27.484163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.484793 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.485267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.486097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.486549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.487541 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.491782 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ef9fd134-958b-4ea7-82af-5a46a5afb645 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.260152 Sep 28 07:33:27.492368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 455/937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:27 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:27.554640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:27.563050 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d25e855e-0e68-4b20-9bb8-495a567adf69 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1300 microversion: 2.1 time: 0.089374 Sep 28 07:33:27.563620 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 483/938] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:27 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:27.594594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:27.595204 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:27.601551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.602039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.602473 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:27.603171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:27.603622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:27.604045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.058613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:28.066696 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-48cacecf-415d-450b-8fab-e40aae340c38 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1505 microversion: 2.1 time: 0.475921 Sep 28 07:33:28.067415 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 456/939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:27 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:28.335796 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:28.336337 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:28.342882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.343369 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.343806 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.344502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.344979 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.345400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.477821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:28.485732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d99c3d2d-3d49-45f9-805f-8140363f0646 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1470 microversion: 2.1 time: 0.153806 Sep 28 07:33:28.486018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 484/940] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:28 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:28.514483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:28.515143 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:28.522231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.522707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.523160 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.523850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.524300 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.524713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.588999 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:28.589822 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:28.596477 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.597123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.597635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.598429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.599138 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.599791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.758378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:28.767713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3f512add-30fd-4812-b89b-a3fc3a5d4729 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.183075 Sep 28 07:33:28.784573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 485/941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:28 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:28.866506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c7c12160-f3c6-4f48-8eb0-c07c8c137a78 req-a1bb22d8-1a8e-4a82-a0b9-fbbe45e2575a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237b8b2c-efde-4e5d-bb53-745c61a95783", "name": "network-vif-deleted", "tag": "3a5dc0ae-1b9e-4e59-9e9c-f4dcfe5ebac9"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:28.900831 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c7c12160-f3c6-4f48-8eb0-c07c8c137a78 req-a1bb22d8-1a8e-4a82-a0b9-fbbe45e2575a service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:28.905660 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c7c12160-f3c6-4f48-8eb0-c07c8c137a78 req-a1bb22d8-1a8e-4a82-a0b9-fbbe45e2575a service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:28.906525 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c7c12160-f3c6-4f48-8eb0-c07c8c137a78 req-a1bb22d8-1a8e-4a82-a0b9-fbbe45e2575a service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:28.924314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:28.933161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c7c12160-f3c6-4f48-8eb0-c07c8c137a78 req-a1bb22d8-1a8e-4a82-a0b9-fbbe45e2575a service nova] Creating event network-vif-deleted:3a5dc0ae-1b9e-4e59-9e9c-f4dcfe5ebac9 for instance 237b8b2c-efde-4e5d-bb53-745c61a95783 on hv-cinder-85944 Sep 28 07:33:28.940009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c7c12160-f3c6-4f48-8eb0-c07c8c137a78 req-a1bb22d8-1a8e-4a82-a0b9-fbbe45e2575a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078691 Sep 28 07:33:28.940821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 486/942] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:28.953992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bca3f4d8-182f-41a4-9852-0660e43a5db9 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1266 microversion: 2.1 time: 0.437953 Sep 28 07:33:28.976085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 457/943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:28 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1266 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:29.091818 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:29.092872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:29.104029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.105340 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.105988 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.106906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.107574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.108185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.149367 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.150077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.150690 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.151324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lazy-loading 'fault' on Instance uuid 237b8b2c-efde-4e5d-bb53-745c61a95783 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:33:29.199725 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5433685dfeb41abaf7c58758390ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b7cf3a259443a9a370b79e2bc43dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:29.208731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b646e4b-aa50-418c-b16c-182f2d462788 tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 200 len: 1304 microversion: 2.1 time: 0.121621 Sep 28 07:33:29.209339 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 487/944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:29 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:29.509558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:29.510458 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:29.523089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.523783 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.524000 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.524704 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.525192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.525615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.600342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:29.608999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-553350f9-5ae3-4c7b-9ae8-bc93ca9204e3 tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1299 microversion: 2.1 time: 0.103387 Sep 28 07:33:29.609577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 458/945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:29 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:29.791148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:29.791770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:29.798281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.798760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.799189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.800712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.801189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.801617 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.934013 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:29.942261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ddb67459-18ad-4ba6-9df0-48d9fa76fffe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.154590 Sep 28 07:33:29.942438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 488/946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:29 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:29.983386 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:29.983997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:29.990667 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.991157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.991620 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:29.992317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:29.992771 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:29.993219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.231875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:30.232872 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:30.233224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] [instance: 237b8b2c-efde-4e5d-bb53-745c61a95783] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:30.242891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-094f23ba-118e-4a1b-8ce6-e0a34f14d905 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1454 microversion: 2.1 time: 0.263302 Sep 28 07:33:30.244447 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 459/947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:29 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1454 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:30.245762 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.246328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.246793 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.247501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.247949 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.248370 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.264261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] HTTP exception thrown: Instance 237b8b2c-efde-4e5d-bb53-745c61a95783 could not be found. Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Request method failure captured: Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 HTTP/1.1 Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_igeiFOsy1ohZ21yWJF2D2PUO4UvyF0qHEmfjLXmwgoUu13BuG8NgjkJpf2KH53w-wvFsdu52yzTEsvqzZ-2D9voYg4Q4vTv2e1xO4ddQAn_QC3cnr_Sikxxc6MZ2GVS0vb6uvXOC55Pf4-OYhRZFDHhPdyhw12Ts1swKAOokc8qBE Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 01b7cf3a259443a9a370b79e2bc43dcc Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesActionsTest-700417914 Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:33:30.266134 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01b7cf3a259443a9a370b79e2bc43dcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01b7cf3a259443a9a370b79e2bc43dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01b7cf3a259443a9a370b79e2bc43dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01b7cf3a259443a9a370b79e2bc43dcc", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesActionsTest-700417914 Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 01b7cf3a259443a9a370b79e2bc43dcc Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesActionsTest-700417914 Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesActionsTest-700417914-project Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: a5433685dfeb41abaf7c58758390ad9b Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesActionsTest-700417914-project Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 237b8b2c-efde-4e5d-bb53-745c61a95783 could not be found. Sep 28 07:33:30.268136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '237b8b2c-efde-4e5d-bb53-745c61a95783'} Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237b8b2c-efde-4e5d-bb53-745c61a95783 could not be found. Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:30.269707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237b8b2c-efde-4e5d-bb53-745c61a95783 could not be found. Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237b8b2c-efde-4e5d-bb53-745c61a95783 could not be found. Sep 28 07:33:30.271014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:33:30.272211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:30.272297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] Returning 404 to user: Instance 237b8b2c-efde-4e5d-bb53-745c61a95783 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:30.272376 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:30.272466 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ae195c01-20fc-41ec-84bb-7d6b3c1b141d tempest-VolumesActionsTest-700417914 tempest-VolumesActionsTest-700417914-project] 10.222.0.52 "GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783" status: 404 len: 111 microversion: 2.1 time: 0.039813 Sep 28 07:33:30.272466 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 489/948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:30 2022] GET /compute/v2.1/servers/237b8b2c-efde-4e5d-bb53-745c61a95783 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:33:30.278757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.279255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.279806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.280412 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.280871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.281367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.415662 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:30.424125 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-141e2b25-3a66-4865-84e6-44ca9297fa6e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1454 microversion: 2.1 time: 0.161691 Sep 28 07:33:30.424864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 460/949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:30 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:30.635529 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:30.636623 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:30.647713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.648552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.649203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.650131 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.650730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.651778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.701790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.702238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.702680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.703362 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lazy-loading 'fault' on Instance uuid 26de492c-9781-4f28-b23c-1106cdfa495a {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:33:30.760244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691641e056634995888c88395d0fb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7235827c243c9828ebca72e47c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:30.767396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4a96b616-fb47-44b9-8940-96e9f5c8ba2a tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 200 len: 1304 microversion: 2.1 time: 0.138285 Sep 28 07:33:30.780993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 490/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:30 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:30.962665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26de492c-9781-4f28-b23c-1106cdfa495a", "name": "network-vif-deleted", "tag": "a42c2ccf-690d-4a83-9807-b8628743a710"}, {"name": "network-changed", "server_uuid": "d8661396-29b3-42b5-9306-ebe79fe5f723", "tag": "693fce48-86c3-42fd-8568-32d50e31f3ac"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:30.966499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:30.967791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:30.968929 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:30.970099 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=26 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:30.977191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.977920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.978544 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.979258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.979846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.980272 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.981789 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:30.982516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:30.983248 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:30.999256 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] Creating event network-vif-deleted:a42c2ccf-690d-4a83-9807-b8628743a710 for instance 26de492c-9781-4f28-b23c-1106cdfa495a on hv-cinder-85944 Sep 28 07:33:31.000077 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] Creating event network-changed:693fce48-86c3-42fd-8568-32d50e31f3ac for instance d8661396-29b3-42b5-9306-ebe79fe5f723 on hv-cinder-85944 Sep 28 07:33:31.009913 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-ad7e5200-5749-4fee-a1d0-4b47c4173851 req-8e78e6b0-15c1-4257-8cc9-f70b15247912 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050789 Sep 28 07:33:31.011170 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 461/951] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:31.250082 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:31.257969 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b4cd6cae-7dec-48ee-ba59-1f4702e396f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.296248 Sep 28 07:33:31.258536 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 491/952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:30 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:31.795567 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:31.796276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] [instance: 26de492c-9781-4f28-b23c-1106cdfa495a] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:31.803410 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:31.803907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:31.804349 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:31.805086 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:31.805547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:31.805976 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:31.821583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] HTTP exception thrown: Instance 26de492c-9781-4f28-b23c-1106cdfa495a could not be found. Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Request method failure captured: Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a HTTP/1.1 Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_iyWTjQCqGDc_9Mj9s_F6fttLJ2QpE4YT8eEs2gyj91t_cWXPXIlDuN_ksTI6mK176vPa6c5qEsWX4szp9g3k6iyFxaos8ZGFGs12V5gCFIHlU61pylbpzdLd6Oa07PlDvbXH6E00jPNonEre-5pOmcMNHu0MbzATXIXk3h3HdtdCE Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: f5a7235827c243c9828ebca72e47c156 Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-VolumesNegativeTest-1199888 Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:33:31.823257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5a7235827c243c9828ebca72e47c156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5a7235827c243c9828ebca72e47c156"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f5a7235827c243c9828ebca72e47c156"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f5a7235827c243c9828ebca72e47c156", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-VolumesNegativeTest-1199888 Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: f5a7235827c243c9828ebca72e47c156 Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-VolumesNegativeTest-1199888 Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-VolumesNegativeTest-1199888-project Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 691641e056634995888c88395d0fb47f Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-VolumesNegativeTest-1199888-project Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 26de492c-9781-4f28-b23c-1106cdfa495a could not be found. Sep 28 07:33:31.824862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '26de492c-9781-4f28-b23c-1106cdfa495a'} Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26de492c-9781-4f28-b23c-1106cdfa495a could not be found. Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:33:31.831080 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26de492c-9781-4f28-b23c-1106cdfa495a could not be found. Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26de492c-9781-4f28-b23c-1106cdfa495a could not be found. Sep 28 07:33:31.832803 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:33:31.834154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] Returning 404 to user: Instance 26de492c-9781-4f28-b23c-1106cdfa495a could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:33:31.834154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e22d5a43-4172-4f75-97b0-83683cd6a07b tempest-VolumesNegativeTest-1199888 tempest-VolumesNegativeTest-1199888-project] 10.222.0.52 "GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a" status: 404 len: 111 microversion: 2.1 time: 0.033593 Sep 28 07:33:31.834154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 462/953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:31 2022] GET /compute/v2.1/servers/26de492c-9781-4f28-b23c-1106cdfa495a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:33:32.281332 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:32.282050 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:32.289804 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:32.290438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:32.291112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:32.292008 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:32.292567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:32.293128 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:32.518087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:32.536743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b5e820f-3f45-4191-8cd7-5d36555cf3fb tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.259304 Sep 28 07:33:32.537706 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 492/954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:32 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:33:32.573581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-1c4cd752-d8a6-4672-93ae-d335f53aab59 req-7c672504-bf60-4c5d-9e29-491efd723741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1499fdb-7b61-4c9e-81d3-09a649f4acab", "tag": "b8112591-d797-4e25-a5d4-e84683e0ddee"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:32.586222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-1c4cd752-d8a6-4672-93ae-d335f53aab59 req-7c672504-bf60-4c5d-9e29-491efd723741 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:32.586813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-1c4cd752-d8a6-4672-93ae-d335f53aab59 req-7c672504-bf60-4c5d-9e29-491efd723741 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:32.587348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-1c4cd752-d8a6-4672-93ae-d335f53aab59 req-7c672504-bf60-4c5d-9e29-491efd723741 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:32.601749 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-1c4cd752-d8a6-4672-93ae-d335f53aab59 req-7c672504-bf60-4c5d-9e29-491efd723741 service nova] Creating event network-changed:b8112591-d797-4e25-a5d4-e84683e0ddee for instance f1499fdb-7b61-4c9e-81d3-09a649f4acab on hv-cinder-85944 Sep 28 07:33:32.609449 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-1c4cd752-d8a6-4672-93ae-d335f53aab59 req-7c672504-bf60-4c5d-9e29-491efd723741 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039018 Sep 28 07:33:32.610229 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 463/955] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:33.559471 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:33.560447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:33.576107 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:33.577543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:33.578031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:33.578855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:33.579382 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:33.579802 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:33.745571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:33.754262 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ef2ee7e9-e063-4956-956b-68a7992df061 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.198559 Sep 28 07:33:33.754837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 493/956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:33 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:34.778066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:34.778761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:34.786132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:34.786739 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:34.787177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:34.787866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:34.788319 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:34.788741 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:35.066368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:35.074477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-64d4d4e8-8f67-4179-a73d-7a6a37d71d03 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.300674 Sep 28 07:33:35.075041 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 464/957] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:34 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:36.098199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:36.099717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:36.111161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:36.111805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:36.112456 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:36.113374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:36.115599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:36.116307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:36.324167 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:36.333500 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-41735738-1efb-4fc9-80f0-eb2f73b37854 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.239340 Sep 28 07:33:36.351100 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 494/958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:36 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:37.355960 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:37.356669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:37.363815 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:37.364587 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:37.365369 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:37.366303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:37.366830 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:37.367351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:37.706778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:37.716574 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-03a8f2f5-d0d2-442f-ad5b-05f3c288493b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.364297 Sep 28 07:33:37.735070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 465/959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:37 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:38.743896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:38.745343 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:38.760227 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:38.760720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:38.761191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:38.761894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:38.762539 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:38.763119 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:38.954397 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:38.969108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b5f71aa6-06ab-4fd0-b401-62ed7aedb709 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.228957 Sep 28 07:33:38.970652 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 495/960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:38 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:39.306137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-32c56808-9df7-4906-8198-d6b573142809 req-effdcde2-207f-4cf9-acc8-6952988f5e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8661396-29b3-42b5-9306-ebe79fe5f723", "name": "network-vif-plugged", "status": "completed", "tag": "693fce48-86c3-42fd-8568-32d50e31f3ac"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:39.328471 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-32c56808-9df7-4906-8198-d6b573142809 req-effdcde2-207f-4cf9-acc8-6952988f5e66 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:39.329564 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-32c56808-9df7-4906-8198-d6b573142809 req-effdcde2-207f-4cf9-acc8-6952988f5e66 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:39.331128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-32c56808-9df7-4906-8198-d6b573142809 req-effdcde2-207f-4cf9-acc8-6952988f5e66 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:39.350390 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-32c56808-9df7-4906-8198-d6b573142809 req-effdcde2-207f-4cf9-acc8-6952988f5e66 service nova] Creating event network-vif-plugged:693fce48-86c3-42fd-8568-32d50e31f3ac for instance d8661396-29b3-42b5-9306-ebe79fe5f723 on hv-cinder-85944 Sep 28 07:33:39.360618 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-32c56808-9df7-4906-8198-d6b573142809 req-effdcde2-207f-4cf9-acc8-6952988f5e66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058712 Sep 28 07:33:39.363770 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 466/961] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:33:39.994816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:39.996911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:40.009737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:40.012659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:40.013671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:40.014609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:40.015704 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:40.016701 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:40.024992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=100 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:40.224567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:40.233396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8f4bc19b-4a61-40b0-93ad-1e898b23766d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.244622 Sep 28 07:33:40.246890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 496/962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:39 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:41.259567 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:41.260505 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:41.283120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:41.284887 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:41.286302 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:41.289491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:41.291242 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:41.291781 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:41.529781 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:41.540606 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0278fe30-ecab-434c-9c30-4c88e5f0c1aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1368 microversion: 2.1 time: 0.285424 Sep 28 07:33:41.554396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 467/963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:41 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:42.565742 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:42.566450 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:42.574300 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=97 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:33:42.576020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:42.584314 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:42.584841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:42.585623 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:42.590849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:42.594707 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:42.797963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:33:42.809983 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c02a2a3d-cf35-47a7-9cfe-3baf775c4d60 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1558 microversion: 2.1 time: 0.248191 Sep 28 07:33:42.813238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 497/964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:33:42 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1558 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:33:42.839968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:33:42.841218 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:33:42.854344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:42.855181 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:42.855699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:42.857177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:42.857789 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:42.858365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:42.982037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ed61ca40-2e41-4bc5-8dc7-5b25a70417b0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145685 Sep 28 07:33:42.983159 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 468/965] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:33:42 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:44.841344 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-172ac484-e16c-4823-af1f-8cadc06a0844 req-29a2b80a-c866-4f45-b691-c0da3a880f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8661396-29b3-42b5-9306-ebe79fe5f723", "tag": "693fce48-86c3-42fd-8568-32d50e31f3ac"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:44.864665 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-172ac484-e16c-4823-af1f-8cadc06a0844 req-29a2b80a-c866-4f45-b691-c0da3a880f3f service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:33:44.867914 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-172ac484-e16c-4823-af1f-8cadc06a0844 req-29a2b80a-c866-4f45-b691-c0da3a880f3f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:33:44.872721 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-172ac484-e16c-4823-af1f-8cadc06a0844 req-29a2b80a-c866-4f45-b691-c0da3a880f3f service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:33:44.901385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-172ac484-e16c-4823-af1f-8cadc06a0844 req-29a2b80a-c866-4f45-b691-c0da3a880f3f service nova] Creating event network-changed:693fce48-86c3-42fd-8568-32d50e31f3ac for instance d8661396-29b3-42b5-9306-ebe79fe5f723 on hv-cinder-85944 Sep 28 07:33:44.911890 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-172ac484-e16c-4823-af1f-8cadc06a0844 req-29a2b80a-c866-4f45-b691-c0da3a880f3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074480 Sep 28 07:33:44.917295 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 498/966] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:33:50.714547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d537b59e-079e-4b9b-8285-907998f9d0c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Action: 'create', calling method: .version_select at 0x7fa861ea79d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-957731964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp5yZ0eIFe6mT3eHs2IH5x8Uf7fM+EJs8o7xiAYD9VCuqM8xwyBp+zgMsuXKtpmWmTxAY7zGtI2e9HNl7xPatR2s5+qULUTduhWUfpCQDIxyz4jahGqq/V7Zj1FF0s6AQ=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:33:50.739978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-d537b59e-079e-4b9b-8285-907998f9d0c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Getting quotas for project 39ec4a1f0d60440c86413595a8eb16ae. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:33:50.746245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-d537b59e-079e-4b9b-8285-907998f9d0c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Getting quotas for user 880d5318ebb145fbb3cd8b02814903f2 and project 39ec4a1f0d60440c86413595a8eb16ae. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:33:50.799523 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d537b59e-079e-4b9b-8285-907998f9d0c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317469 Sep 28 07:33:50.818290 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 469/967] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:33:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:07.410572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:07.411346 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:07.415887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1579698446", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "networks": [{"uuid": "635326ad-e47d-4334-b397-e69515520095"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:07.623047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] validate_networks() for [('635326ad-e47d-4334-b397-e69515520095', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:34:07.977969 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:34:07.978389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:34:07.978860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:34:07.979267 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:34:07.979671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:34:07.988266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:07.988736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:07.989194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:07.989909 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:07.990358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:07.990773 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:08.006912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Getting quotas for project 8e8bbfbde29f4df1ba0d4ea32e8a15d4. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:34:08.010801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Getting quotas for user d7ff2b03e1d940d28cf8e7f1c675ff09 and project 8e8bbfbde29f4df1ba0d4ea32e8a15d4. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:34:08.021909 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:34:08.024209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:34:08.068843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ca5888f3-949c-4547-b3d7-a464fa735540 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660512 Sep 28 07:34:08.069520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 499/968] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:34:08.080573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-62d84ec4-fd55-4d5a-9bee-58b7eda887c4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:08.081309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-62d84ec4-fd55-4d5a-9bee-58b7eda887c4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:08.084504 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=88 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:08.085590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:08.087335 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:08.196043 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-62d84ec4-fd55-4d5a-9bee-58b7eda887c4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:08.203448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-62d84ec4-fd55-4d5a-9bee-58b7eda887c4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1219 microversion: 2.1 time: 0.126804 Sep 28 07:34:08.204177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 470/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:08 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:09.227938 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:09.228535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:09.235473 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:09.235960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:09.236396 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:09.237120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:09.237573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:09.237993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:09.302950 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:09.310815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-28306a3b-ea14-4465-a0e9-2e9662aa5d09 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1271 microversion: 2.1 time: 0.087807 Sep 28 07:34:09.311480 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 500/970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:09 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:10.335007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:10.335605 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:10.342785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:10.343269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:10.343713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:10.344561 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:10.345066 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:10.345506 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:10.625375 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:10.633492 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1dacc69a-3ec7-4063-a550-df6c953820a9 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1319 microversion: 2.1 time: 0.302875 Sep 28 07:34:10.634198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 471/971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:10 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:10.791734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-998341a3-bded-425e-94d3-e3f01d3803f5 req-877fde80-1118-4f8c-aad3-eb34b5725426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1466f71c-5f2e-4186-b4c7-04096f244289", "tag": "d8e0f143-67b0-4615-85ff-0c75266c6e52"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:10.803536 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-998341a3-bded-425e-94d3-e3f01d3803f5 req-877fde80-1118-4f8c-aad3-eb34b5725426 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:10.804120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-998341a3-bded-425e-94d3-e3f01d3803f5 req-877fde80-1118-4f8c-aad3-eb34b5725426 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:10.806027 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-998341a3-bded-425e-94d3-e3f01d3803f5 req-877fde80-1118-4f8c-aad3-eb34b5725426 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:10.825346 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-998341a3-bded-425e-94d3-e3f01d3803f5 req-877fde80-1118-4f8c-aad3-eb34b5725426 service nova] Creating event network-changed:d8e0f143-67b0-4615-85ff-0c75266c6e52 for instance 1466f71c-5f2e-4186-b4c7-04096f244289 on hv-cinder-85944 Sep 28 07:34:10.831507 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-998341a3-bded-425e-94d3-e3f01d3803f5 req-877fde80-1118-4f8c-aad3-eb34b5725426 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042834 Sep 28 07:34:10.833058 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 501/972] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:34:11.657079 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:11.657701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:11.664647 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:11.665157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:11.665589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:11.666273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:11.666729 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:11.667132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:11.792688 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:11.800320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3275a139-2433-4d87-9655-ecaf11838daa tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1319 microversion: 2.1 time: 0.147170 Sep 28 07:34:11.800879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 472/973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:11 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:12.824132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:12.824820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:12.830924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:12.831399 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:12.831825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:12.832498 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:12.833004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:12.833423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:12.961898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:12.969931 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a7592abe-5dd1-412f-80fb-c961a0ed6fe2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1319 microversion: 2.1 time: 0.150361 Sep 28 07:34:12.970433 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 502/974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:12 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:13.994600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:13.995194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:14.001635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:14.002111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:14.002543 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:14.003224 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:14.003670 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:14.004089 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:14.065153 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1096774261", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-957731964", "security_groups": [{"name": "tempest-secgroup-smoke-1931169372"}], "networks": [{"uuid": "380ba3a3-882e-4070-8873-539d55af7b49"}], "block_device_mapping_v2": [{"uuid": "b5cde6d7-7097-4297-98ad-52e4b30896a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:14.133357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:14.141690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ff3f4c60-8598-41aa-b7a3-34d5021b372b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1319 microversion: 2.1 time: 0.151667 Sep 28 07:34:14.146109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 473/975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:13 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:14.179666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] validate_networks() for [('380ba3a3-882e-4070-8873-539d55af7b49', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:34:14.549550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:34:14.549972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:34:14.550502 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:34:14.550882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:34:14.551637 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:34:14.560257 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:14.560731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:14.561190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:14.561961 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:14.562411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:14.562827 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:14.579549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Getting quotas for project 39ec4a1f0d60440c86413595a8eb16ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:34:14.584271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Getting quotas for user 880d5318ebb145fbb3cd8b02814903f2 and project 39ec4a1f0d60440c86413595a8eb16ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:34:14.640891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:34:14.643025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5cde6d7-7097-4297-98ad-52e4b30896a5',volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:34:14.779084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-11af62c8-2542-4c01-8eec-468b4f972b9d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718035 Sep 28 07:34:14.779730 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 503/976] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:34:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 07:34:14.791582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-67a145f3-5e5c-45b4-8d9d-73736bb3d986 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:14.792251 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-67a145f3-5e5c-45b4-8d9d-73736bb3d986 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:14.883227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-67a145f3-5e5c-45b4-8d9d-73736bb3d986 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:14.892736 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-67a145f3-5e5c-45b4-8d9d-73736bb3d986 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1088 microversion: 2.1 time: 0.104874 Sep 28 07:34:14.904968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 474/977] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:14 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1088 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:34:15.166727 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:15.167373 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:15.175100 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:15.175589 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:15.176067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:15.177285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:15.177864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:15.178285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:15.222439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-e3535f0f-8547-4cc0-8518-dbb64d3c9d7b req-ba2238c1-a012-4963-9847-9f79d99540ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1466f71c-5f2e-4186-b4c7-04096f244289", "name": "network-vif-plugged", "status": "completed", "tag": "d8e0f143-67b0-4615-85ff-0c75266c6e52"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:15.240351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e3535f0f-8547-4cc0-8518-dbb64d3c9d7b req-ba2238c1-a012-4963-9847-9f79d99540ad service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:15.241333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e3535f0f-8547-4cc0-8518-dbb64d3c9d7b req-ba2238c1-a012-4963-9847-9f79d99540ad service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:15.241947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e3535f0f-8547-4cc0-8518-dbb64d3c9d7b req-ba2238c1-a012-4963-9847-9f79d99540ad service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:15.262978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-e3535f0f-8547-4cc0-8518-dbb64d3c9d7b req-ba2238c1-a012-4963-9847-9f79d99540ad service nova] Creating event network-vif-plugged:d8e0f143-67b0-4615-85ff-0c75266c6e52 for instance 1466f71c-5f2e-4186-b4c7-04096f244289 on hv-cinder-85944 Sep 28 07:34:15.269911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-e3535f0f-8547-4cc0-8518-dbb64d3c9d7b req-ba2238c1-a012-4963-9847-9f79d99540ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051069 Sep 28 07:34:15.270981 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 475/978] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:34:15.326549 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:15.334723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a4d873a5-f70e-490e-bd78-4c1ca2be8433 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1319 microversion: 2.1 time: 0.173377 Sep 28 07:34:15.335283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 504/979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:15 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:15.916939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:15.917601 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:15.923793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:15.924253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:15.924689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:15.925409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:15.925862 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:15.926287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:15.989854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:15.997553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-544df893-ed28-44f8-826c-1c9219cf71e1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1130 microversion: 2.1 time: 0.084939 Sep 28 07:34:15.998112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 476/980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:15 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:16.358459 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:16.359056 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:16.365482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:16.365959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:16.366386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:16.367060 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:16.367509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:16.367921 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:16.494209 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:16.501988 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a1d57bb7-ff61-42f1-b5a0-fadb8ea1f400 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1319 microversion: 2.1 time: 0.147432 Sep 28 07:34:16.502537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 505/981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:16 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:17.020703 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:17.021344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:17.027621 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:17.028097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:17.028524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:17.029226 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:17.029678 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:17.030090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:17.091208 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:17.099385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d4b1f10e-0d21-4a67-ac0b-85313b659462 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1186 microversion: 2.1 time: 0.081789 Sep 28 07:34:17.099969 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 477/982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:17 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:17.526017 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:17.526645 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:17.532919 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:17.533436 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:17.533865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:17.534545 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:17.534996 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:17.535416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:17.669643 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:17.677654 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-09350645-2d3c-4ac2-9d4d-de1bea47ee14 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1507 microversion: 2.1 time: 0.155540 Sep 28 07:34:17.684434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 506/983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:17 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:18.122047 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:18.122728 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:18.131628 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:18.132742 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:18.133205 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:18.136690 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:18.137412 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:18.138097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:18.236616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:18.244957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0c36a610-c666-425c-a7b6-4baf5afc366e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1204 microversion: 2.1 time: 0.127286 Sep 28 07:34:18.245685 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 478/984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:18 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:19.267878 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:19.268495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:19.275045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:19.275533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:19.275968 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:19.276658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:19.277151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:19.277574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:19.412126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:19.420003 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5046bbad-ffdd-4445-aed2-7b04c86eb7ce tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.155873 Sep 28 07:34:19.420508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 507/985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:19 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:19.493699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-139e0e4f-7c5f-4e00-9f39-8bf0bc6ed72a req-e260a6f2-560d-452c-a6fb-823d6ea9d0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:19.504216 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-139e0e4f-7c5f-4e00-9f39-8bf0bc6ed72a req-e260a6f2-560d-452c-a6fb-823d6ea9d0ac service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:19.505253 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-139e0e4f-7c5f-4e00-9f39-8bf0bc6ed72a req-e260a6f2-560d-452c-a6fb-823d6ea9d0ac service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:19.505679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-139e0e4f-7c5f-4e00-9f39-8bf0bc6ed72a req-e260a6f2-560d-452c-a6fb-823d6ea9d0ac service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:19.516522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-139e0e4f-7c5f-4e00-9f39-8bf0bc6ed72a req-e260a6f2-560d-452c-a6fb-823d6ea9d0ac service nova] Creating event network-changed:1915b73a-7b44-4a13-af78-132204143dd2 for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d on hv-cinder-85944 Sep 28 07:34:19.522164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-139e0e4f-7c5f-4e00-9f39-8bf0bc6ed72a req-e260a6f2-560d-452c-a6fb-823d6ea9d0ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031996 Sep 28 07:34:19.522760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 479/986] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:20.443311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:20.444177 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:20.450816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:20.451292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:20.451720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:20.452407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:20.452855 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:20.453301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:20.597098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:20.605438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-23f6bdca-4f0e-4241-832a-a9b34b8c0e4e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.166129 Sep 28 07:34:20.606009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 508/987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:20 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:21.630165 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:21.630849 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:21.636935 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:21.637435 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:21.637861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:21.638542 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:21.638990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:21.639405 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:21.776568 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:21.784225 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0bfa92df-70f9-4a0c-83c3-8be99bd25709 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.159458 Sep 28 07:34:21.784785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 480/988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:21 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:22.807604 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:22.808202 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:22.814864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:22.815336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:22.815760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:22.816429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:22.816875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:22.817320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:22.952114 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:22.959755 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e1dfcf1f-e945-499c-8777-8f1f3e203bb0 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.155891 Sep 28 07:34:22.960252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 509/989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:22 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:23.982035 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:23.982576 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:23.988897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:23.989407 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:23.989959 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:23.990605 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:23.991058 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:23.991474 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:24.117178 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:24.124760 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c9981638-0f54-47d7-a74c-def69373f53e tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.146769 Sep 28 07:34:24.125352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 481/990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:23 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:25.148398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:25.150551 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:25.153527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=4 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:25.154445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=12 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:25.160365 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:25.161224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:25.162261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:25.163174 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:25.163623 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:25.164046 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:25.296625 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:25.304393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8d3b3870-5cb8-4e87-89da-7863a13670f4 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.160494 Sep 28 07:34:25.304972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 510/991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:25 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:26.327052 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:26.327717 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:26.329705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:26.335836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:26.336321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:26.336761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:26.337477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:26.337934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:26.338358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:26.469665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:26.478635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-797ad4db-32f9-4517-a5b7-59c819101dfe tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.155474 Sep 28 07:34:26.479215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 482/992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:26 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:34:27.501605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:27.502159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:27.508665 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:27.509171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:27.509598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:27.510264 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:27.510710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:27.511123 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:27.641217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:27.650141 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0d8b07c0-e78e-479e-b494-0cbad45b2937 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.152433 Sep 28 07:34:27.650766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 511/993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:27 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:28.672430 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:28.673072 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:28.680609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:28.681124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:28.681565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:28.682261 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:28.682705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:28.683129 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:28.827608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:28.835268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-02ed0a27-29ae-4732-ba95-9badc8941d73 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.166730 Sep 28 07:34:28.835827 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 483/994] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:28 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:29.273694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-6e95682f-8824-4b9b-9653-2f0368bf59bd req-beec9769-177f-4417-9711-804496eb3ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "name": "network-vif-plugged", "status": "completed", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:29.283389 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6e95682f-8824-4b9b-9653-2f0368bf59bd req-beec9769-177f-4417-9711-804496eb3ba7 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:29.283883 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6e95682f-8824-4b9b-9653-2f0368bf59bd req-beec9769-177f-4417-9711-804496eb3ba7 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:29.284378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-6e95682f-8824-4b9b-9653-2f0368bf59bd req-beec9769-177f-4417-9711-804496eb3ba7 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:29.296119 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-6e95682f-8824-4b9b-9653-2f0368bf59bd req-beec9769-177f-4417-9711-804496eb3ba7 service nova] Creating event network-vif-plugged:1915b73a-7b44-4a13-af78-132204143dd2 for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d on hv-cinder-85944 Sep 28 07:34:29.300997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-6e95682f-8824-4b9b-9653-2f0368bf59bd req-beec9769-177f-4417-9711-804496eb3ba7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Sep 28 07:34:29.301580 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 512/995] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:29.858321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:29.858888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:29.865356 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:29.865842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:29.866282 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:29.866969 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:29.867428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:29.867851 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:30.266187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:30.274692 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8d45a907-4da9-4618-90c3-0e99ec0877b6 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1260 microversion: 2.1 time: 0.420402 Sep 28 07:34:30.275249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 484/996] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:29 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1260 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:31.299724 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:31.300435 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:31.307319 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:31.307828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:31.308262 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:31.309037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:31.309518 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:31.309957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:31.450534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:31.458183 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a334f408-dc13-4264-a450-9741f1437ac8 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1444 microversion: 2.1 time: 0.163432 Sep 28 07:34:31.459384 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 513/997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:31 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:31.480665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:31.481255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:31.487635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:31.488120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:31.488556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:31.489277 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:31.489784 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:31.490211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:31.621116 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:31.628716 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-dd0eb3d4-11d1-4dc2-97b8-6ecb53ea739f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1444 microversion: 2.1 time: 0.152024 Sep 28 07:34:31.629298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 485/998] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:31 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:32.297090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:32.297590 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:32.304825 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:32.305448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:32.305760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:32.306449 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:32.306900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:32.307319 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:32.330586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-29536e61-15b6-4de3-959d-6f7e9f967dcd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/ips" status: 200 len: 149 microversion: 2.1 time: 0.037458 Sep 28 07:34:32.331157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 514/999] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:34:32 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:33.362012 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-5e05878e-cbf8-469d-8a27-96329701ebec req-bc710299-2e68-41fb-aef7-356f3eb91333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:33.372174 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-5e05878e-cbf8-469d-8a27-96329701ebec req-bc710299-2e68-41fb-aef7-356f3eb91333 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:33.372609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-5e05878e-cbf8-469d-8a27-96329701ebec req-bc710299-2e68-41fb-aef7-356f3eb91333 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:33.373062 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-5e05878e-cbf8-469d-8a27-96329701ebec req-bc710299-2e68-41fb-aef7-356f3eb91333 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:33.384527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-5e05878e-cbf8-469d-8a27-96329701ebec req-bc710299-2e68-41fb-aef7-356f3eb91333 service nova] Creating event network-changed:1915b73a-7b44-4a13-af78-132204143dd2 for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d on hv-cinder-85944 Sep 28 07:34:33.389745 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-5e05878e-cbf8-469d-8a27-96329701ebec req-bc710299-2e68-41fb-aef7-356f3eb91333 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031325 Sep 28 07:34:33.390933 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 486/1000] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:33.742100 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b8f401-85f1-44e4-9be1-bdd0317af1fc"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:33.745057 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:33.750974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:33.751537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:33.752084 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:33.753524 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:33.754064 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:33.754575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:34.075416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-45a99c6b-943c-44f4-9de2-851322d05168 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339020 Sep 28 07:34:34.081320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 515/1001] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:34:33 2022] POST /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:39.283809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db9c4317-dea9-4551-822f-3d4bfe98e203", "device": "/dev/sdb"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:39.287638 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:39.289754 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=39 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:39.295378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:39.295853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:39.296281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:39.296978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:39.297429 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:39.297843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:39.301524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=79 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:39.561232 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1db7bf91-ee23-420a-9993-30bda501d10b tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "POST /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282480 Sep 28 07:34:39.561942 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 487/1002] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:34:39 2022] POST /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:41.631569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b8f401-85f1-44e4-9be1-bdd0317af1fc"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:41.634076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:41.637009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:41.642429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:41.642900 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:41.643325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:41.644004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:41.644448 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:41.644857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:41.648156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:34:41.728398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Invalid volume: volume 59b8f401-85f1-44e4-9be1-bdd0317af1fc is already attached to instances: d8661396-29b3-42b5-9306-ebe79fe5f723 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: POST /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments HTTP/1.1 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 74 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:34:41.730190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {"volumeAttachment": {"volumeId": "59b8f401-85f1-44e4-9be1-bdd0317af1fc"}} Sep 28 07:34:41.731734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Invalid volume: volume 59b8f401-85f1-44e4-9be1-bdd0317af1fc is already attached to instances: d8661396-29b3-42b5-9306-ebe79fe5f723 Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'server_id': 'd8661396-29b3-42b5-9306-ebe79fe5f723', 'body': {'volumeAttachment': {'volumeId': '59b8f401-85f1-44e4-9be1-bdd0317af1fc'}}} Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 59b8f401-85f1-44e4-9be1-bdd0317af1fc is already attached to instances: d8661396-29b3-42b5-9306-ebe79fe5f723 Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:34:41.732562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 59b8f401-85f1-44e4-9be1-bdd0317af1fc is already attached to instances: d8661396-29b3-42b5-9306-ebe79fe5f723 Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:34:41.733894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 59b8f401-85f1-44e4-9be1-bdd0317af1fc is already attached to instances: d8661396-29b3-42b5-9306-ebe79fe5f723 Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 400 to user: Invalid volume: volume 59b8f401-85f1-44e4-9be1-bdd0317af1fc is already attached to instances: d8661396-29b3-42b5-9306-ebe79fe5f723 {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-654aa2b0-d26c-4286-a1b4-6accac8aadca tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105236 Sep 28 07:34:41.735274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 516/1003] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:34:41 2022] POST /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 07:34:41.798617 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:41.799192 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:41.805840 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:41.806314 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:41.806737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:41.807416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:41.807864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:41.808281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:41.888655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lazy-loading 'services' on Instance uuid d8661396-29b3-42b5-9306-ebe79fe5f723 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:34:41.963902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-caa5a1dd-52eb-470e-9f3e-6793f046176e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments/59b8f401-85f1-44e4-9be1-bdd0317af1fc" status: 202 len: 0 microversion: 2.1 time: 0.169885 Sep 28 07:34:41.964482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 488/1004] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:34:41 2022] DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments/59b8f401-85f1-44e4-9be1-bdd0317af1fc => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:34:41.972659 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:41.976146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:41.983015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:41.983493 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:41.983920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:41.984866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:41.985527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:41.986071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:42.019113 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4316c84f-752b-4a1f-842b-97004b7a01fc tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050271 Sep 28 07:34:42.019664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 517/1005] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:41 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:43.032566 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:43.034902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:43.041187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:43.041665 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:43.042094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:43.042772 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:43.043220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:43.043637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:43.074317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f4ddac83-f236-4125-ae9d-2b63c4875076 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Sep 28 07:34:43.074863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 489/1006] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:43 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:44.087408 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:44.089597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:44.096009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:44.096434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:44.096867 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:44.097578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:44.098031 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:44.098524 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:44.127127 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-fe7e6fcd-c984-49a7-ba05-3f82c83a56c0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Sep 28 07:34:44.127673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 518/1007] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:44 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:45.140083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:45.142190 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:45.148636 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:45.149155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:45.149590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:45.150266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:45.150710 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:45.151130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:45.180881 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a52c819b-9708-4d52-a9e4-7cc253bc3cfd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Sep 28 07:34:45.181453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 490/1008] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:45 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:46.194359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:46.196553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:46.203265 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:46.203763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:46.204197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:46.204879 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:46.205401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:46.205799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:46.234817 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e5fd95b4-9d84-4e87-819c-821be3f769f8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Sep 28 07:34:46.235289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 519/1009] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:46 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:34:47.247403 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:47.249504 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:47.256275 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:47.256747 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:47.257208 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:47.257884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:47.258333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:47.258745 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:47.288014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ca71035b-19ab-479e-81b1-47f637e88af2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Sep 28 07:34:47.288551 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 491/1010] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:47 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:48.300538 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:48.303219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:48.310981 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:48.311506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:48.312219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:48.313293 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:48.314311 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:48.315214 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:48.364914 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-84d6204b-3232-4daa-afce-f9af2f9b67fe tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068943 Sep 28 07:34:48.365495 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 520/1011] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:48 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:49.377128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:49.379278 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:49.385763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:49.386240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:49.386666 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:49.387348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:49.387792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:49.388208 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:49.417669 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-84c5907d-b8fd-4d29-8859-680bbc096a5a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 28 07:34:49.418211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 492/1012] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:49 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:50.430515 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:50.432760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:50.439429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:50.439911 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:50.440348 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:50.441062 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:50.441517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:50.442077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:50.471336 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88b6946f-6067-449f-8e44-ba58dcc8d994 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Sep 28 07:34:50.471888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 521/1013] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:50 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:51.484433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:51.486639 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:51.493796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:51.494274 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:51.494705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:51.495400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:51.495843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:51.496259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:51.530951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-07a3417b-07ae-4153-a6bf-fd6058866930 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050461 Sep 28 07:34:51.531500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 493/1014] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:51 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:52.543530 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:52.545736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:52.554325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:52.555353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:52.556301 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:52.557786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:52.558700 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:52.559435 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:52.593588 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6b10f8d2-c722-4b6b-918a-eb01c6a6de0a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054041 Sep 28 07:34:52.594140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 522/1015] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:34:52 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:34:52.669286 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:52.669817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:52.676589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:52.677911 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:52.678346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:52.679025 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:52.679616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:52.680101 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:52.708932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:34:52.784341 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-210aba54-e0f8-4ec7-97bd-33d6aa1260f1 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 204 len: 0 microversion: 2.1 time: 0.118713 Sep 28 07:34:52.784928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 494/1016] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:34:52 2022] DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:34:52.794888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:52.795407 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:52.801388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:52.801860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:52.802522 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:52.803199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:52.803644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:52.804059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:52.953645 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:52.962242 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0462f9cf-4db2-484d-9ecb-bb6d4de2e5c3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1682 microversion: 2.1 time: 0.172002 Sep 28 07:34:52.962828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 523/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:52 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:53.987171 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:53.987806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:53.994109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:53.994586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:53.995010 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:53.995691 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:53.996134 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:53.996550 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:54.127483 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:54.135804 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b728f8ec-265d-4cfd-823a-5a85f578776f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1682 microversion: 2.1 time: 0.153095 Sep 28 07:34:54.136405 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 495/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:53 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:55.160063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:55.160669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:55.168342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:55.168830 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:55.169286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:55.169973 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:55.170416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:55.170830 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:55.295739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:55.303421 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40c113f2-1dba-49e1-9d2e-68dbaa9f7cd6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1682 microversion: 2.1 time: 0.147211 Sep 28 07:34:55.303974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 524/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:55 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:56.327522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:56.328109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:56.334481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:56.334955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:56.335380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:56.336058 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:56.336503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:56.336918 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:56.532090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:56.540374 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-25b91037-81c5-4c61-8e21-8f630ffe8990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1682 microversion: 2.1 time: 0.216744 Sep 28 07:34:56.541166 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 496/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:56 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:57.280896 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-9e6f308e-b487-47f5-8a84-184375e84eba req-dd51d357-836e-45f9-b2df-ed3358646021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8661396-29b3-42b5-9306-ebe79fe5f723", "name": "network-vif-deleted", "tag": "693fce48-86c3-42fd-8568-32d50e31f3ac"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:34:57.295413 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9e6f308e-b487-47f5-8a84-184375e84eba req-dd51d357-836e-45f9-b2df-ed3358646021 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:57.296194 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9e6f308e-b487-47f5-8a84-184375e84eba req-dd51d357-836e-45f9-b2df-ed3358646021 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:57.296623 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-9e6f308e-b487-47f5-8a84-184375e84eba req-dd51d357-836e-45f9-b2df-ed3358646021 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:57.308982 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-9e6f308e-b487-47f5-8a84-184375e84eba req-dd51d357-836e-45f9-b2df-ed3358646021 service nova] Creating event network-vif-deleted:693fce48-86c3-42fd-8568-32d50e31f3ac for instance d8661396-29b3-42b5-9306-ebe79fe5f723 on hv-cinder-85944 Sep 28 07:34:57.314255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-9e6f308e-b487-47f5-8a84-184375e84eba req-dd51d357-836e-45f9-b2df-ed3358646021 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 Sep 28 07:34:57.314902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 525/1021] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:34:57.563764 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:57.564375 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:57.571899 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:57.572385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:57.572814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:57.573616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:57.574094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:57.574511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:57.635894 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:57.643679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f454cd48-9566-4e9b-9ba6-d17d9380edc9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1327 microversion: 2.1 time: 0.084081 Sep 28 07:34:57.644245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 497/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:57 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1327 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:34:58.668241 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:58.668939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:58.675149 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:58.675629 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:58.676059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:58.677478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:58.677939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:58.678364 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:58.741378 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:58.748929 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f55fdb2-cc86-4458-b036-27ead117b536 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1327 microversion: 2.1 time: 0.085375 Sep 28 07:34:58.749506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 526/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:58 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1327 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:34:59.772459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:34:59.773108 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:34:59.779591 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:59.780078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:59.780512 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:59.781231 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:34:59.781683 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:34:59.782105 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:34:59.842296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:34:59.850107 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-592e1032-d6f5-46a2-8009-7d76a7bfdbdf tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1327 microversion: 2.1 time: 0.082138 Sep 28 07:34:59.850661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 498/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:34:59 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1327 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:00.871971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:00.872572 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:00.879005 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:00.879491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:00.880445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:00.881189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:00.881646 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:00.882069 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:00.912685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:00.913197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:00.913635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:00.914074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lazy-loading 'fault' on Instance uuid d8661396-29b3-42b5-9306-ebe79fe5f723 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:35:00.956525 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:00.964197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88d8c8c2-73c2-42f2-89be-d729d0274db5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 200 len: 1332 microversion: 2.1 time: 0.096207 Sep 28 07:35:00.964751 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 527/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:00 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:01.987986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:01.988508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:01.995045 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:01.995529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:01.995955 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:01.996635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:01.997111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:01.997529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:02.010786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 HTTP/1.1 Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:35:02.012431 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:35:02.014109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'd8661396-29b3-42b5-9306-ebe79fe5f723'} Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:35:02.014979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:35:02.016513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:35:02.017902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:35:02.017902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e37f91b6-07a4-41e1-b3ec-2f8b166f52b6 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 404 len: 111 microversion: 2.1 time: 0.029991 Sep 28 07:35:02.017902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 499/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:01 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:35:02.023291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4376befc-0edd-4121-a7ba-3bd549f70b14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '.version_select at 0x7fa86574b0d0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:02.042021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4376befc-0edd-4121-a7ba-3bd549f70b14 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876371491" status: 202 len: 0 microversion: 2.1 time: 0.023182 Sep 28 07:35:02.043967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 528/1027] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 07:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876371491 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 07:35:02.649359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b5ae51d7-0d02-4fb6-86fd-ea3c57784388 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: .version_select at 0x7fa861e92b80>, body: {"keypair": {"name": "tempest-keypair-1707708311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzoS0DWluiK6YJUotYkUDaRRlKiLX2cteF2oI+nqBxoUTXwDYQNsXY0fkpoRzeE9u2gl9ULTToU6S17IXvVOCO3fcsdCfiXB21Z0TWlkJQg6pgrXBZa8vmT+/SQqx43zw=="}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:02.664616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-b5ae51d7-0d02-4fb6-86fd-ea3c57784388 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:35:02.668338 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-b5ae51d7-0d02-4fb6-86fd-ea3c57784388 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'key_pairs'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:35:02.690890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b5ae51d7-0d02-4fb6-86fd-ea3c57784388 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045605 Sep 28 07:35:02.691475 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 500/1028] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 07:35:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:03.961870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-439930777", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "733608a5-23eb-466d-8629-abe8aafc7bed"}], "security_groups": [{"name": "tempest-securitygroup--1818089052"}], "key_name": "tempest-keypair-1707708311", "user_data": "}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:04.061940 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] validate_networks() for [('733608a5-23eb-466d-8629-abe8aafc7bed', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:35:04.418983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:04.419491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:04.425166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:35:04.425620 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:35:04.426094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:35:04.427116 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:35:04.427527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:35:04.427741 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:04.428228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:04.428658 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:04.429383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:04.429839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:04.430359 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:04.436691 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:04.437603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:04.438027 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:04.438738 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:04.439185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:04.439624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:04.456865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:35:04.460871 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Getting quotas for user 44adfe9a391948f68dc747448546063e and project 94a0b09b62ce47678fd542a0453c3d17. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:35:04.472028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:35:04.475102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:35:04.510896 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:04.516884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.objects.instance [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lazy-loading 'services' on Instance uuid 1466f71c-5f2e-4186-b4c7-04096f244289 {{(pid=120451) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:35:04.524190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b9c14c48-a3bb-4745-a89a-650bdeb7dbb2 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567316 Sep 28 07:35:04.525042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 529/1029] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:35:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:35:04.535575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-40643ef4-e2e8-4622-bdc9-a96fb6371267 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:04.536891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-40643ef4-e2e8-4622-bdc9-a96fb6371267 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:04.600164 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-40643ef4-e2e8-4622-bdc9-a96fb6371267 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:04.607681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c9e15f24-eb69-4ccd-ae84-f14c75cf9f5d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289/os-volume_attachments/db9c4317-dea9-4551-822f-3d4bfe98e203" status: 202 len: 0 microversion: 2.1 time: 0.192562 Sep 28 07:35:04.608325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-40643ef4-e2e8-4622-bdc9-a96fb6371267 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1241 microversion: 2.1 time: 0.076418 Sep 28 07:35:04.611897 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 501/1030] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:35:04 2022] DELETE /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289/os-volume_attachments/db9c4317-dea9-4551-822f-3d4bfe98e203 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 07:35:04.612021 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 530/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:04 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:05.631962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:05.632657 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:05.638854 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:05.639334 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:05.639763 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:05.640445 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:05.640891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:05.641333 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:05.702623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:05.710668 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c20c64da-f3e8-4707-bbdc-0609f9de0afd tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1293 microversion: 2.1 time: 0.083950 Sep 28 07:35:05.711234 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 502/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:05 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:05.743792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:05.744335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:05.750658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:05.751133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:05.751562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:05.752238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:05.752685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:05.753137 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:05.778175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:35:05.853798 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4b760687-43cb-4ab4-9092-9cecd8e596d4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 204 len: 0 microversion: 2.1 time: 0.113503 Sep 28 07:35:05.854386 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 531/1033] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:35:05 2022] DELETE /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:35:05.862402 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:05.863014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:05.870374 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:05.870866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:05.871361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:05.872030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:05.872791 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:05.873401 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:06.006313 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:06.013980 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d67426f8-5ab4-4f06-8596-eec26e5742b2 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1513 microversion: 2.1 time: 0.155416 Sep 28 07:35:06.014543 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 503/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:05 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:06.734427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:06.735122 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:06.741164 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:06.741640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:06.742071 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:06.742739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:06.743184 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:06.743598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:06.804388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:06.811863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9a7010f1-8279-4833-8d72-7d77f181b5ed tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1301 microversion: 2.1 time: 0.081636 Sep 28 07:35:06.812675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 532/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:06 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:07.037595 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:07.038206 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:07.044546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:07.045068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:07.045508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:07.046194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:07.046644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:07.047067 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:07.179121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:07.186719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e690b3a1-1efb-4ea4-8b08-d956b23f0062 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1513 microversion: 2.1 time: 0.153163 Sep 28 07:35:07.187544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 504/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:07 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:07.835580 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:07.836169 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:07.843907 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:07.845501 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:07.846105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:07.846838 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:07.847922 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:07.849189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:07.920767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:07.931079 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0537175d-fe0a-48c3-8ce0-88b554b015ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1301 microversion: 2.1 time: 0.099731 Sep 28 07:35:07.931658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 533/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:07 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:08.210559 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:08.211296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:08.217722 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:08.218218 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:08.218648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:08.219354 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:08.219808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:08.220219 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:08.517486 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:08.525201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ccdb2bbf-87df-42bd-9a89-d8cbd2cbbb75 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1513 microversion: 2.1 time: 0.319001 Sep 28 07:35:08.525778 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 505/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:08 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:08.954327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:08.955672 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:08.964820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:08.965429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:08.965963 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:08.966847 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:08.967310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:08.967733 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:08.971124 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:09.114395 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:09.123591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-165ef7b9-f6fb-4850-ac9f-e666ea2c46e4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.173081 Sep 28 07:35:09.124178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 534/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:08 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:09.456885 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-351ade37-8176-41a7-8e62-f9cb779e19a4 req-b8328825-7aa1-419e-8536-c7aa0dc1cad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1466f71c-5f2e-4186-b4c7-04096f244289", "name": "network-vif-deleted", "tag": "d8e0f143-67b0-4615-85ff-0c75266c6e52"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:09.462432 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:09.469866 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-351ade37-8176-41a7-8e62-f9cb779e19a4 req-b8328825-7aa1-419e-8536-c7aa0dc1cad5 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:09.470586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-351ade37-8176-41a7-8e62-f9cb779e19a4 req-b8328825-7aa1-419e-8536-c7aa0dc1cad5 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:09.471904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-351ade37-8176-41a7-8e62-f9cb779e19a4 req-b8328825-7aa1-419e-8536-c7aa0dc1cad5 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:09.493069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-351ade37-8176-41a7-8e62-f9cb779e19a4 req-b8328825-7aa1-419e-8536-c7aa0dc1cad5 service nova] Creating event network-vif-deleted:d8e0f143-67b0-4615-85ff-0c75266c6e52 for instance 1466f71c-5f2e-4186-b4c7-04096f244289 on hv-cinder-85944 Sep 28 07:35:09.500450 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-351ade37-8176-41a7-8e62-f9cb779e19a4 req-b8328825-7aa1-419e-8536-c7aa0dc1cad5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117848 Sep 28 07:35:09.501301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 506/1040] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:35:09.549445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:09.550069 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:09.556974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:09.557805 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:09.558238 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:09.558926 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:09.559563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:09.559775 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:09.609170 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:09.609656 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:09.610090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:09.610535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lazy-loading 'fault' on Instance uuid 1466f71c-5f2e-4186-b4c7-04096f244289 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:35:09.653946 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:09.662229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f3cd1e01-d139-4c75-9a05-48dae239b548 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 200 len: 1309 microversion: 2.1 time: 0.116835 Sep 28 07:35:09.662865 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 535/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:09 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:10.148713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:10.149925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:10.161795 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:10.163293 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:10.163907 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:10.164834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:10.165478 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:10.166209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:10.381859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:10.389603 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f8cbee6f-5676-4ba5-a157-4ac7c0616e9a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.246186 Sep 28 07:35:10.390307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 507/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:10 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:10.686283 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:10.686848 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: 1466f71c-5f2e-4186-b4c7-04096f244289] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:10.693974 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:10.694462 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:10.694898 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:10.695607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:10.696062 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:10.696481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:10.711664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] HTTP exception thrown: Instance 1466f71c-5f2e-4186-b4c7-04096f244289 could not be found. Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Request method failure captured: Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 HTTP/1.1 Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_jtW-u0ph9Sk0LMpsYQYx871ZHnV3yvmFKGFHfBa1NcqvRw0u9TFWZ5wRMQ15bstenNAAQPtQM4r5vZPLYfCpUer0v1jbYky_M2SIRnXvpENf2eXdl_TaLoNwz2-JAcC1XZYR4eWBD0Ct3RnfUfVSxl2a8vc4aDECkhvtj0MmjKkhI Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 8e8bbfbde29f4df1ba0d4ea32e8a15d4 Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesSnapshotTestJSON-526307953 Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:35:10.713345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e8bbfbde29f4df1ba0d4ea32e8a15d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e8bbfbde29f4df1ba0d4ea32e8a15d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e8bbfbde29f4df1ba0d4ea32e8a15d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e8bbfbde29f4df1ba0d4ea32e8a15d4", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesSnapshotTestJSON-526307953 Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 8e8bbfbde29f4df1ba0d4ea32e8a15d4 Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-526307953 Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesSnapshotTestJSON-526307953-project Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: d7ff2b03e1d940d28cf8e7f1c675ff09 Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesSnapshotTestJSON-526307953-project Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 1466f71c-5f2e-4186-b4c7-04096f244289 could not be found. Sep 28 07:35:10.715047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '1466f71c-5f2e-4186-b4c7-04096f244289'} Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1466f71c-5f2e-4186-b4c7-04096f244289 could not be found. Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:35:10.716087 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1466f71c-5f2e-4186-b4c7-04096f244289 could not be found. Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1466f71c-5f2e-4186-b4c7-04096f244289 could not be found. Sep 28 07:35:10.718207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:35:10.719875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Returning 404 to user: Instance 1466f71c-5f2e-4186-b4c7-04096f244289 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:35:10.719875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bba6cfb5-cc93-43c4-9635-0f2b1debe1ec tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289" status: 404 len: 111 microversion: 2.1 time: 0.032444 Sep 28 07:35:10.719875 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 536/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:10 2022] GET /compute/v2.1/servers/1466f71c-5f2e-4186-b4c7-04096f244289 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:35:11.414036 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:11.414649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:11.421113 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:11.421594 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:11.422051 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:11.422743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:11.423201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:11.423624 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:11.523597 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-b4163840-3d14-46e8-85f1-028891e5501f req-2a05d5ee-f532-4181-87f5-a84f72f8ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68e86b2-b7b2-4203-bee8-fc0f0a4e5717", "tag": "2121c7de-ea77-474c-8451-264d8e66b866"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:11.532967 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b4163840-3d14-46e8-85f1-028891e5501f req-2a05d5ee-f532-4181-87f5-a84f72f8ad1c service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:11.533451 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b4163840-3d14-46e8-85f1-028891e5501f req-2a05d5ee-f532-4181-87f5-a84f72f8ad1c service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:11.533877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-b4163840-3d14-46e8-85f1-028891e5501f req-2a05d5ee-f532-4181-87f5-a84f72f8ad1c service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:11.545438 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-b4163840-3d14-46e8-85f1-028891e5501f req-2a05d5ee-f532-4181-87f5-a84f72f8ad1c service nova] Creating event network-changed:2121c7de-ea77-474c-8451-264d8e66b866 for instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 on hv-cinder-85944 Sep 28 07:35:11.550550 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-b4163840-3d14-46e8-85f1-028891e5501f req-2a05d5ee-f532-4181-87f5-a84f72f8ad1c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031096 Sep 28 07:35:11.551145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 537/1044] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:35:11.560097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:11.567965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7128b100-5d0f-4dcd-ad8e-cd590b4e89aa tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.158779 Sep 28 07:35:11.568496 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 508/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:11 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:12.592803 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:12.593533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:12.595531 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:12.602081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:12.602404 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:12.603136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:12.603917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:12.604371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:12.604797 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:12.738553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:12.746699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1e58a7e4-1673-4b88-8c50-32d528f4484c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.158636 Sep 28 07:35:12.747258 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 538/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:12 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:13.769180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:13.769934 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:13.772577 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=4 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:13.778198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:13.778682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:13.779120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:13.779810 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:13.780265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:13.780697 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:13.912057 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:13.919846 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1741a613-7280-4dd5-9e73-5a97c42b4f28 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.154520 Sep 28 07:35:13.920417 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 509/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:13 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:14.944390 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:14.945025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:14.947315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:14.947992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=8 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:14.954096 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:14.954578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:14.955004 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:14.955684 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:14.956131 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:14.956546 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:15.087127 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:15.094620 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f39d1d70-9707-424b-a5d3-2d8c7c2e6739 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.154782 Sep 28 07:35:15.095178 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 539/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:14 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:16.117465 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:16.118187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:16.125246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:16.125723 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:16.126152 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:16.126841 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:16.127284 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:16.127735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:16.256890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:16.264494 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a15a1efd-3e29-497d-b327-120f3624bcf8 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.151438 Sep 28 07:35:16.265090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 510/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:16 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:17.287093 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:17.287702 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:17.294067 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:17.294542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:17.294975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:17.295651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:17.296098 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:17.296509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:17.423400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:17.431861 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-648049bb-2cda-4f45-8941-8d73f6c8c540 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.148714 Sep 28 07:35:17.432731 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 540/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:17 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:18.455357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:18.455989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:18.462920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:18.463394 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:18.463820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:18.464500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:18.464963 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:18.465380 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:18.590260 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:18.597923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8db8661a-8831-4d6d-9975-ab9f9dd40157 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.146151 Sep 28 07:35:18.598583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 511/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:18 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:19.555136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1883304111", "imageRef": "c5d689d2-1df6-4594-b98b-95a34353f6a9", "flavorRef": "452", "networks": [{"uuid": "635326ad-e47d-4334-b397-e69515520095"}]}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:19.617268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.network.neutron [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] validate_networks() for [('635326ad-e47d-4334-b397-e69515520095', None, None, None, None, None)] {{(pid=120452) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:35:19.620582 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:19.621285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:19.627381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:19.627937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:19.628439 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:19.629994 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:19.630530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:19.631021 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:19.768083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:19.776346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a927a6b8-4e2e-4b74-93e4-80a470aba20f tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.159622 Sep 28 07:35:19.776908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 512/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:19 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:20.014427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Flavor limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:35:20.014833 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Image limits 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:35:20.015307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Flavor pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:35:20.015735 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Image pref 0:0:0 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:35:20.016126 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.virt.hardware [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120452) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:35:20.024923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:20.025433 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:20.025866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:20.026595 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:20.027075 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:20.027499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:20.044132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Getting quotas for project 8e8bbfbde29f4df1ba0d4ea32e8a15d4. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:35:20.048041 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.quota [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Getting quotas for user d7ff2b03e1d940d28cf8e7f1c675ff09 and project 8e8bbfbde29f4df1ba0d4ea32e8a15d4. Resources: {'cores', 'instances', 'ram'} {{(pid=120452) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:35:20.059616 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Going to run 1 instances... {{(pid=120452) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:35:20.062159 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5d689d2-1df6-4594-b98b-95a34353f6a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120452) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:35:20.107962 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7ccf0491-8e1c-4c6a-bd1f-2f53ca6f08ca tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557951 Sep 28 07:35:20.108655 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 541/1053] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:35:20.120306 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2188fd19-a50e-4a1e-a6ff-748e040ab83e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:20.120923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2188fd19-a50e-4a1e-a6ff-748e040ab83e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:20.174312 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2188fd19-a50e-4a1e-a6ff-748e040ab83e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:20.182133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2188fd19-a50e-4a1e-a6ff-748e040ab83e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1219 microversion: 2.1 time: 0.065570 Sep 28 07:35:20.182692 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 513/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:20 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:20.801836 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:20.802429 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:20.808885 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:20.809400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:20.810040 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:20.810846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:20.811381 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:20.812161 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:20.947307 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:20.954966 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53c963d0-57b8-47de-962f-26b6f3c40f94 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.158685 Sep 28 07:35:20.955517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 542/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:20 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:21.205508 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:21.206049 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:21.213646 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:21.214129 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:21.214565 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:21.215249 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:21.215701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:21.216119 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:21.277165 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:21.284656 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-02414160-b64b-4334-841f-769bd37a824e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1271 microversion: 2.1 time: 0.083074 Sep 28 07:35:21.285902 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 514/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:21 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:21.518849 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a9171e05-56c6-4191-b729-1b156834a42d req-4472958a-a2bd-4af0-b36c-a2e35d825d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68e86b2-b7b2-4203-bee8-fc0f0a4e5717", "name": "network-vif-plugged", "status": "completed", "tag": "2121c7de-ea77-474c-8451-264d8e66b866"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:21.532777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a9171e05-56c6-4191-b729-1b156834a42d req-4472958a-a2bd-4af0-b36c-a2e35d825d61 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:21.532986 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a9171e05-56c6-4191-b729-1b156834a42d req-4472958a-a2bd-4af0-b36c-a2e35d825d61 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:21.533563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a9171e05-56c6-4191-b729-1b156834a42d req-4472958a-a2bd-4af0-b36c-a2e35d825d61 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:21.550411 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a9171e05-56c6-4191-b729-1b156834a42d req-4472958a-a2bd-4af0-b36c-a2e35d825d61 service nova] Creating event network-vif-plugged:2121c7de-ea77-474c-8451-264d8e66b866 for instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 on hv-cinder-85944 Sep 28 07:35:21.558222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a9171e05-56c6-4191-b729-1b156834a42d req-4472958a-a2bd-4af0-b36c-a2e35d825d61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043571 Sep 28 07:35:21.558978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 543/1057] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:21.978592 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:21.979238 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:21.985328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:21.985809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:21.986241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:21.986932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:21.987421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:21.987838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:22.218130 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:22.226284 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2b30e47d-c11c-4970-8fa6-93426c8efdb3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.251543 Sep 28 07:35:22.226850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 515/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:21 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:22.308552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:22.309345 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:22.315750 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:22.317136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:22.317136 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:22.317824 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:22.318279 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:22.318694 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:22.446708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:22.454359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a2c341a9-3430-4ff9-8e04-6707180a4860 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.150488 Sep 28 07:35:22.454918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 544/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:22 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:22.935026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-8b8517e0-7c0f-4975-86ed-bc2bc456e315 req-ab24ca6c-54d3-412a-a1dd-406b07d12ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36f20ac-b51d-46f2-9b74-e3ced1538014", "tag": "eb57722a-da56-41ba-896c-464cbb73213d"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:22.945453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8b8517e0-7c0f-4975-86ed-bc2bc456e315 req-ab24ca6c-54d3-412a-a1dd-406b07d12ffd service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:22.945940 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8b8517e0-7c0f-4975-86ed-bc2bc456e315 req-ab24ca6c-54d3-412a-a1dd-406b07d12ffd service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:22.946695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-8b8517e0-7c0f-4975-86ed-bc2bc456e315 req-ab24ca6c-54d3-412a-a1dd-406b07d12ffd service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:22.957233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-8b8517e0-7c0f-4975-86ed-bc2bc456e315 req-ab24ca6c-54d3-412a-a1dd-406b07d12ffd service nova] Creating event network-changed:eb57722a-da56-41ba-896c-464cbb73213d for instance f36f20ac-b51d-46f2-9b74-e3ced1538014 on hv-cinder-85944 Sep 28 07:35:22.962185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-8b8517e0-7c0f-4975-86ed-bc2bc456e315 req-ab24ca6c-54d3-412a-a1dd-406b07d12ffd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030853 Sep 28 07:35:22.962773 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 516/1060] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:23.248821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:23.249553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:23.255639 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:23.256212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:23.256708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:23.257541 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:23.258157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:23.258720 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:23.389176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:23.397542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-dd759de3-1a8a-42f7-81b2-0e83d10aaee3 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1367 microversion: 2.1 time: 0.152803 Sep 28 07:35:23.398110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 545/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:23 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:23.480378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:23.481206 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:23.487979 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:23.489884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:23.489884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:23.490425 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:23.490906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:23.491353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:23.621888 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:23.629416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e1f11483-6069-4fa2-b1ca-17f776bfc6b4 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.153974 Sep 28 07:35:23.629965 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 517/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:23 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:24.420652 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:24.421416 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:24.428308 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:24.428790 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:24.429297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:24.429937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:24.430388 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:24.430804 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:24.560810 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:24.569078 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3ca1562b-89cd-4b11-9a93-3e6b46ecf3ae tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1557 microversion: 2.1 time: 0.152371 Sep 28 07:35:24.569648 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 546/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:24 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:24.591157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:24.591693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:24.598707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:24.599182 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:24.599616 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:24.600305 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:24.600757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:24.601204 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:24.651620 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:24.652347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:24.658306 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:24.658853 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:24.659352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:24.660739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:24.661310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:24.661732 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:24.677796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c12d872f-3d4d-4fa5-bc18-26174f968ca4 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090429 Sep 28 07:35:24.678420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 518/1064] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 07:35:24 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:24.792408 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:24.799990 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7cebe12-e33f-4925-b12f-3809d6423353 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.152269 Sep 28 07:35:24.801718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 547/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:24 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:25.823613 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:25.824395 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:25.832808 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:25.833493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:25.833997 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:25.834843 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:25.835364 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:25.835857 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:25.855063 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-a0f09ab9-e653-4597-97d9-eb91e5cd2d29 req-d030f6e5-4595-4ab1-b8c6-aec4d29636d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68e86b2-b7b2-4203-bee8-fc0f0a4e5717", "tag": "2121c7de-ea77-474c-8451-264d8e66b866"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:25.865163 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a0f09ab9-e653-4597-97d9-eb91e5cd2d29 req-d030f6e5-4595-4ab1-b8c6-aec4d29636d1 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:25.865634 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a0f09ab9-e653-4597-97d9-eb91e5cd2d29 req-d030f6e5-4595-4ab1-b8c6-aec4d29636d1 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:25.866054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-a0f09ab9-e653-4597-97d9-eb91e5cd2d29 req-d030f6e5-4595-4ab1-b8c6-aec4d29636d1 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:25.877592 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-a0f09ab9-e653-4597-97d9-eb91e5cd2d29 req-d030f6e5-4595-4ab1-b8c6-aec4d29636d1 service nova] Creating event network-changed:2121c7de-ea77-474c-8451-264d8e66b866 for instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 on hv-cinder-85944 Sep 28 07:35:25.882864 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-a0f09ab9-e653-4597-97d9-eb91e5cd2d29 req-d030f6e5-4595-4ab1-b8c6-aec4d29636d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031824 Sep 28 07:35:25.883454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 548/1066] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:35:26.029411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:26.038347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-7c2b3c69-3dae-4fe0-b413-11702216f775 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.218496 Sep 28 07:35:26.039012 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 519/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:25 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:27.063150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:27.063841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:27.070059 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:27.070533 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:27.070959 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:27.071644 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:27.072090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:27.072506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:27.201536 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:27.210110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f02cb9c9-e0ce-453e-9442-da9bc640a64c tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.151946 Sep 28 07:35:27.210676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 549/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:27 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:28.233533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:28.234123 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:28.240493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:28.240990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:28.241420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:28.242094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:28.242536 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:28.242950 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:28.257347 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:28.373377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:28.381596 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ac6ada73-97fb-4635-95d2-5883aae54ac7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.152037 Sep 28 07:35:28.382154 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 520/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:28 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:29.405432 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:29.406064 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:29.413002 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:29.413486 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:29.413917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:29.414605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:29.415053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:29.415465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:29.548417 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:29.556633 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6a3d6f28-0762-479f-bff6-1e700b0ac038 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.154932 Sep 28 07:35:29.557562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 550/1070] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:29 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:29.630469 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-4274b6ec-69fd-4fca-8191-9dc6b25e102b req-19e9ea94-b80e-43b8-9663-514011630d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36f20ac-b51d-46f2-9b74-e3ced1538014", "name": "network-vif-plugged", "status": "completed", "tag": "eb57722a-da56-41ba-896c-464cbb73213d"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:29.640063 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-4274b6ec-69fd-4fca-8191-9dc6b25e102b req-19e9ea94-b80e-43b8-9663-514011630d81 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:29.640480 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-4274b6ec-69fd-4fca-8191-9dc6b25e102b req-19e9ea94-b80e-43b8-9663-514011630d81 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:29.640906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-4274b6ec-69fd-4fca-8191-9dc6b25e102b req-19e9ea94-b80e-43b8-9663-514011630d81 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:29.651744 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-4274b6ec-69fd-4fca-8191-9dc6b25e102b req-19e9ea94-b80e-43b8-9663-514011630d81 service nova] Creating event network-vif-plugged:eb57722a-da56-41ba-896c-464cbb73213d for instance f36f20ac-b51d-46f2-9b74-e3ced1538014 on hv-cinder-85944 Sep 28 07:35:29.656608 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-4274b6ec-69fd-4fca-8191-9dc6b25e102b req-19e9ea94-b80e-43b8-9663-514011630d81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092882 Sep 28 07:35:29.657220 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 521/1071] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:30.579510 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:30.580117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:30.582791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:30.583454 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=6 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:30.589717 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:30.590200 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:30.590674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:30.591342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:30.591787 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:30.592205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:30.721712 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:30.729553 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-e04caee5-80c5-4e93-bb36-cabd8e0fd44e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1319 microversion: 2.1 time: 0.153909 Sep 28 07:35:30.730110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 551/1072] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:30 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:31.749042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:31.753919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:31.754612 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:31.760928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:31.761428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:31.761853 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:31.762529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:31.762978 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:31.763391 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:31.890276 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:31.898569 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e883ecc2-bd52-4c61-8c31-3dcab3f59f4d tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1508 microversion: 2.1 time: 0.150575 Sep 28 07:35:31.899128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 522/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:31 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:31.921593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d09b50c-7eea-4dc7-96bb-3007f76b5bb8", "device": "/dev/sdb"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:31.924414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:31.930335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:31.930816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:31.931254 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:31.931939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:31.932391 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:31.932812 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:32.167230 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:32.186315 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0e246085-8e27-4e09-a83f-1c6520747abf tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "POST /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268673 Sep 28 07:35:32.187203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 552/1074] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:35:31 2022] POST /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:55.191126 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2040360802", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1817965910", "security_groups": [{"name": "tempest-secgroup-smoke-401944427"}], "block_device_mapping_v2": [{"uuid": "2f49a0b6-6112-4c8f-beab-e7016eb2afec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3597cb55-79da-4b37-872b-aa28123264c5"}]}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:55.202081 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=35 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:55.202867 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=11 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:55.304211 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.network.neutron [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] validate_networks() for [('3597cb55-79da-4b37-872b-aa28123264c5', None, None, None, None, None)] {{(pid=120451) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 07:35:55.728724 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Flavor limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 07:35:55.729209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Image limits 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 07:35:55.729682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Flavor pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 07:35:55.730090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Image pref 0:0:0 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 07:35:55.730497 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.virt.hardware [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120451) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 07:35:55.739259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:55.739905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:55.740589 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:55.741468 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:55.741926 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:55.742346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:55.758914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 07:35:55.763190 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.quota [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Getting quotas for user 04cf365443b44d9d87338d95b5b0251b and project bfa33399f5994fb4a1ad804fa6e75f8b. Resources: {'cores', 'instances', 'ram'} {{(pid=120451) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 07:35:55.821168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Going to run 1 instances... {{(pid=120451) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 07:35:55.823287 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f49a0b6-6112-4c8f-beab-e7016eb2afec',volume_size=None,volume_type=None)] {{(pid=120451) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 07:35:55.952975 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d50d0f96-bf80-48bc-a1d6-cadd08485a7e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.765799 Sep 28 07:35:55.953601 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 523/1075] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 07:35:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 07:35:55.963491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:55.964313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:35:55.969743 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-605b077f-a237-42fd-bd8a-de09b743d08c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:55.970617 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-605b077f-a237-42fd-bd8a-de09b743d08c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:56.027173 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-605b077f-a237-42fd-bd8a-de09b743d08c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:56.034199 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-605b077f-a237-42fd-bd8a-de09b743d08c tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1095 microversion: 2.1 time: 0.072249 Sep 28 07:35:56.034772 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 553/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:55 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:57.058583 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:57.059188 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:57.065510 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:57.065987 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:57.066414 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:57.067097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:57.067546 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:57.068580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:57.134580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:57.142516 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-03728e3f-6c10-4159-979b-b836804e1438 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1193 microversion: 2.1 time: 0.088562 Sep 28 07:35:57.143074 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 524/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:57 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:57.736250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:57.736924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:57.744121 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:57.744681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:57.745213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:57.745992 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:57.746514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:57.747001 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:57.841117 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lazy-loading 'services' on Instance uuid f36f20ac-b51d-46f2-9b74-e3ced1538014 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:35:57.922692 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-94cc4250-1cf3-40cc-a494-262adfcb26f1 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014/os-volume_attachments/0d09b50c-7eea-4dc7-96bb-3007f76b5bb8" status: 202 len: 0 microversion: 2.1 time: 0.189880 Sep 28 07:35:57.926660 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 554/1078] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:35:57 2022] DELETE /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014/os-volume_attachments/0d09b50c-7eea-4dc7-96bb-3007f76b5bb8 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:35:58.165779 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:58.166549 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:58.173309 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:58.173801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:58.174268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:58.174975 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:58.175433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:58.175875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:58.385729 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:58.393350 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f10e7b80-a2db-4133-813e-e816bee0bff5 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.232134 Sep 28 07:35:58.393923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 525/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:58 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:35:58.773848 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-7fde99a6-ac01-4670-ab29-b1c083781a82 req-0e331bc6-5c96-4976-9da5-27a49ca58818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c39356-6319-4671-901b-e1a6067332ef", "tag": "e3f9fb34-9b9b-415a-8e1a-224fd1f63698"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:35:58.793674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7fde99a6-ac01-4670-ab29-b1c083781a82 req-0e331bc6-5c96-4976-9da5-27a49ca58818 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:58.794115 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7fde99a6-ac01-4670-ab29-b1c083781a82 req-0e331bc6-5c96-4976-9da5-27a49ca58818 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:58.794560 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-7fde99a6-ac01-4670-ab29-b1c083781a82 req-0e331bc6-5c96-4976-9da5-27a49ca58818 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:58.810165 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-7fde99a6-ac01-4670-ab29-b1c083781a82 req-0e331bc6-5c96-4976-9da5-27a49ca58818 service nova] Creating event network-changed:e3f9fb34-9b9b-415a-8e1a-224fd1f63698 for instance 59c39356-6319-4671-901b-e1a6067332ef on hv-cinder-85944 Sep 28 07:35:58.815263 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-7fde99a6-ac01-4670-ab29-b1c083781a82 req-0e331bc6-5c96-4976-9da5-27a49ca58818 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045693 Sep 28 07:35:58.815966 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 555/1080] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:35:59.075841 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:59.076268 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:59.082493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:59.082986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:59.083455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:59.084499 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:59.085011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:59.085452 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:59.112545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:35:59.192581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-0dbd3612-35be-4311-8d53-199f88835097 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 204 len: 0 microversion: 2.1 time: 0.120509 Sep 28 07:35:59.193894 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 526/1081] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:35:59 2022] DELETE /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:35:59.202418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:59.203282 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:59.210401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:59.211028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:59.211537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:59.212309 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:59.212851 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:59.213359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:59.347672 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:59.355859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ba540e26-d346-48ea-b7ef-e9b6f56a3b42 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1514 microversion: 2.1 time: 0.157848 Sep 28 07:35:59.356418 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 556/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:59 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:35:59.421586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:35:59.422315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:35:59.428168 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:59.428647 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:59.429111 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:59.429793 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:35:59.430242 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:35:59.430661 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:35:59.559884 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:35:59.567785 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9edf6720-deab-479e-9181-b25517efff07 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.150422 Sep 28 07:35:59.568348 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 527/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:35:59 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:00.378854 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:00.379457 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:00.386349 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:00.386820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:00.387246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:00.387918 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:00.388363 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:00.388780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:00.516927 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:00.524677 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-57bd617a-fabd-4fbc-a736-5e975beb342e tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1514 microversion: 2.1 time: 0.149708 Sep 28 07:36:00.525260 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 557/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:00 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:00.590432 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:00.591039 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:00.597480 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:00.597956 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:00.598385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:00.599649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:00.600146 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:00.600561 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:00.726864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:00.734495 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f8a24a59-5e2c-47af-b187-584c60a6c786 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.147926 Sep 28 07:36:00.735056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 528/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:00 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:01.548091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:01.548676 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:01.555617 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:01.556092 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:01.556520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:01.557225 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:01.557674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:01.558085 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:01.687094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:01.695217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9f7b5d79-24ef-4105-add5-222f19ee3b44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1514 microversion: 2.1 time: 0.150934 Sep 28 07:36:01.695873 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 558/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:01 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:01.761719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:01.762432 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:01.768863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:01.769544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:01.770042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:01.771426 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:01.772074 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:01.772493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:02.119883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:02.127547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-04b1c249-26d4-449b-8df4-5a6da0704526 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.369678 Sep 28 07:36:02.128317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 529/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:01 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:02.719038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:02.719658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:02.728777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:02.729552 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:02.730203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:02.732229 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:02.732925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:02.733840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:02.788980 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-e3b9bbe8-2e20-4ab9-9758-263780762ceb req-1b9cdaed-660d-4a3e-a155-ea89d4aeeb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36f20ac-b51d-46f2-9b74-e3ced1538014", "name": "network-vif-deleted", "tag": "eb57722a-da56-41ba-896c-464cbb73213d"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:02.799302 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e3b9bbe8-2e20-4ab9-9758-263780762ceb req-1b9cdaed-660d-4a3e-a155-ea89d4aeeb18 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:02.799786 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e3b9bbe8-2e20-4ab9-9758-263780762ceb req-1b9cdaed-660d-4a3e-a155-ea89d4aeeb18 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:02.800215 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-e3b9bbe8-2e20-4ab9-9758-263780762ceb req-1b9cdaed-660d-4a3e-a155-ea89d4aeeb18 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:02.805857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ff2b03e1d940d28cf8e7f1c675ff09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bbfbde29f4df1ba0d4ea32e8a15d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:02.814648 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-368afa59-144a-4128-954a-57efe4c260a7 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 200 len: 1472 microversion: 2.1 time: 0.099585 Sep 28 07:36:02.817151 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 559/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:02 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:02.821990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-e3b9bbe8-2e20-4ab9-9758-263780762ceb req-1b9cdaed-660d-4a3e-a155-ea89d4aeeb18 service nova] Creating event network-vif-deleted:eb57722a-da56-41ba-896c-464cbb73213d for instance f36f20ac-b51d-46f2-9b74-e3ced1538014 on hv-cinder-85944 Sep 28 07:36:02.833659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-e3b9bbe8-2e20-4ab9-9758-263780762ceb req-1b9cdaed-660d-4a3e-a155-ea89d4aeeb18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049104 Sep 28 07:36:02.834477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 530/1089] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:36:03.150108 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:03.150708 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:03.156512 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:03.157015 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:03.157445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:03.158118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:03.158563 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:03.158976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:03.284793 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:03.293009 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-1c70e862-7175-4593-be9a-730268a5d8d8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.146711 Sep 28 07:36:03.293568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 560/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:03 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:03.844526 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:03.845258 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] [instance: f36f20ac-b51d-46f2-9b74-e3ced1538014] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:03.852397 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:03.852879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:03.853440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:03.854194 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:03.854659 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:03.855092 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:03.868699 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] HTTP exception thrown: Instance f36f20ac-b51d-46f2-9b74-e3ced1538014 could not be found. Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Request method failure captured: Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 HTTP/1.1 Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_jtW-u0ph9Sk0LMpsYQYx871ZHnV3yvmFKGFHfBa1NcqvRw0u9TFWZ5wRMQ15bstenNAAQPtQM4r5vZPLYfCpUer0v1jbYky_M2SIRnXvpENf2eXdl_TaLoNwz2-JAcC1XZYR4eWBD0Ct3RnfUfVSxl2a8vc4aDECkhvtj0MmjKkhI Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 8e8bbfbde29f4df1ba0d4ea32e8a15d4 Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-VolumesSnapshotTestJSON-526307953 Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:03.870342 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e8bbfbde29f4df1ba0d4ea32e8a15d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e8bbfbde29f4df1ba0d4ea32e8a15d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e8bbfbde29f4df1ba0d4ea32e8a15d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e8bbfbde29f4df1ba0d4ea32e8a15d4", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-VolumesSnapshotTestJSON-526307953 Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 8e8bbfbde29f4df1ba0d4ea32e8a15d4 Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-526307953 Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-VolumesSnapshotTestJSON-526307953-project Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: d7ff2b03e1d940d28cf8e7f1c675ff09 Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-VolumesSnapshotTestJSON-526307953-project Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance f36f20ac-b51d-46f2-9b74-e3ced1538014 could not be found. Sep 28 07:36:03.871957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'f36f20ac-b51d-46f2-9b74-e3ced1538014'} Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36f20ac-b51d-46f2-9b74-e3ced1538014 could not be found. Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:03.872839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36f20ac-b51d-46f2-9b74-e3ced1538014 could not be found. Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36f20ac-b51d-46f2-9b74-e3ced1538014 could not be found. Sep 28 07:36:03.874491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:03.876128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] Returning 404 to user: Instance f36f20ac-b51d-46f2-9b74-e3ced1538014 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:03.876128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-59975093-36f2-47c0-8d42-69bd37ee1c44 tempest-VolumesSnapshotTestJSON-526307953 tempest-VolumesSnapshotTestJSON-526307953-project] 10.222.0.52 "GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014" status: 404 len: 111 microversion: 2.1 time: 0.036474 Sep 28 07:36:03.876128 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 531/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:03 2022] GET /compute/v2.1/servers/f36f20ac-b51d-46f2-9b74-e3ced1538014 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:04.315766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:04.316374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:04.322819 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:04.323285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:04.323710 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:04.324383 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:04.324828 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:04.325275 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:04.450997 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:04.458555 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bbeaa82c-85fd-49b8-a5e3-ee1816ae15c8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.146686 Sep 28 07:36:04.459118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 561/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:04 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:05.481109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:05.481713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:05.487977 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:05.488454 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:05.488880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:05.490127 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:05.490572 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:05.490991 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:05.619511 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:05.627377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-06ff8b8b-1f07-4b80-8d82-921918513d2d tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.150084 Sep 28 07:36:05.627925 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 532/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:05 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:06.651478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:06.652014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:06.654420 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell0:SELECT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:06.659783 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:06.660245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:06.660681 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:06.661390 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:06.662019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:06.662434 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:06.791993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:06.799564 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-af74e37f-0e6f-4c45-887c-50f72e48e26a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.152010 Sep 28 07:36:06.800120 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 562/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:06 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:07.822358 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:07.822962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:07.824893 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:07.825573 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell0:SELECT=6 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:07.832131 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:07.832609 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:07.833682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:07.834365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:07.834809 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:07.835224 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:07.967512 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:07.975346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6935635e-db5a-495d-a2fe-5e58dc45b96a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.156894 Sep 28 07:36:07.975906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 533/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:07 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:08.998569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:08.999106 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:09.005630 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:09.006105 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:09.006535 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:09.007217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:09.007666 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:09.008091 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:09.136605 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:09.144323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-08526767-af6e-4242-8817-0ffa3c30601e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.149764 Sep 28 07:36:09.144891 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 563/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:08 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:10.167740 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:10.168378 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:10.174530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:10.175007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:10.175438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:10.176114 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:10.177090 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:10.177537 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:10.311433 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:10.319196 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-11cb116d-b21d-4044-8812-69324f8bc093 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.155242 Sep 28 07:36:10.319757 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 534/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:10 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:11.341780 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:11.342414 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:11.348913 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:11.349530 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:11.349964 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:11.350687 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:11.351140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:11.351561 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:11.493514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:11.501782 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f43008b6-80bf-49dc-a089-1217412582a7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.163923 Sep 28 07:36:11.502547 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 564/1098] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:11 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:36:12.525799 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:12.526365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:12.532633 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:12.533156 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:12.533584 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:12.534263 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:12.534705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:12.535119 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:12.665524 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:12.673305 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ef3705e4-da70-4215-b546-83a377bdc8b4 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.151441 Sep 28 07:36:12.673868 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 535/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:12 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:13.024207 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-c3fba546-f877-4444-8c09-4e33affbb164 req-3a6fa37b-e9d5-4e0e-b600-9a7ba45c4d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c39356-6319-4671-901b-e1a6067332ef", "name": "network-vif-plugged", "status": "completed", "tag": "e3f9fb34-9b9b-415a-8e1a-224fd1f63698"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:13.034359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c3fba546-f877-4444-8c09-4e33affbb164 req-3a6fa37b-e9d5-4e0e-b600-9a7ba45c4d3d service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:13.034851 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c3fba546-f877-4444-8c09-4e33affbb164 req-3a6fa37b-e9d5-4e0e-b600-9a7ba45c4d3d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:13.035318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-c3fba546-f877-4444-8c09-4e33affbb164 req-3a6fa37b-e9d5-4e0e-b600-9a7ba45c4d3d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:13.046928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-c3fba546-f877-4444-8c09-4e33affbb164 req-3a6fa37b-e9d5-4e0e-b600-9a7ba45c4d3d service nova] Creating event network-vif-plugged:e3f9fb34-9b9b-415a-8e1a-224fd1f63698 for instance 59c39356-6319-4671-901b-e1a6067332ef on hv-cinder-85944 Sep 28 07:36:13.052419 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-c3fba546-f877-4444-8c09-4e33affbb164 req-3a6fa37b-e9d5-4e0e-b600-9a7ba45c4d3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Sep 28 07:36:13.053203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 565/1100] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:13.695758 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:13.696372 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:13.702806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:13.703288 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:13.703720 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:13.704409 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:13.704858 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:13.705303 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:13.844423 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:13.852694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-9143f8aa-33b1-4398-8024-35bdccb05e1f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.160954 Sep 28 07:36:13.853281 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 536/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:13 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:14.876401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:14.877045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:14.883198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:14.883679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:14.884111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:14.884791 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:14.885277 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:14.885686 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:15.012446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:15.020028 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ad7bdb63-17d0-4b5c-a83b-2c96c609b5b1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.148444 Sep 28 07:36:15.020757 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 566/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:14 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:16.042037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:16.042641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:16.049085 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:16.049562 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:16.049992 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:16.050673 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:16.051119 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:16.052028 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:16.184263 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:16.194307 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ddf49be7-3a95-4f1c-b3d2-1b219ceecef8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.155868 Sep 28 07:36:16.194883 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 537/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:16 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:17.217295 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:17.217889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:17.224313 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:17.224781 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:17.225244 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:17.225916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:17.226379 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:17.226903 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:17.357628 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:17.367160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-88c5e34f-f6d8-4db3-9136-e3c86c073102 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1266 microversion: 2.1 time: 0.153678 Sep 28 07:36:17.367726 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 567/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:17 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:18.391279 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:18.392527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:18.400679 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:18.401186 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:18.401619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:18.402301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:18.402970 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:18.403579 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:18.603343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:18.611114 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-88323bc8-1ead-4785-a528-49687f2dad65 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1453 microversion: 2.1 time: 0.223705 Sep 28 07:36:18.611701 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 538/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:18 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:18.634370 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:18.634984 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:18.641445 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:18.641927 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:18.642359 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:18.643047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:18.643499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:18.643920 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:18.775769 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:18.783328 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-6aea236a-a1a6-471b-aa79-dec4c8f3fdc8 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1453 microversion: 2.1 time: 0.152883 Sep 28 07:36:18.783893 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 568/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:18 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:20.522872 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-75881745-c879-4be0-be76-ea91574a3a0d req-8e9f1b2d-22d4-4026-a1fe-f764545858ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c39356-6319-4671-901b-e1a6067332ef", "tag": "e3f9fb34-9b9b-415a-8e1a-224fd1f63698"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:20.532834 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-75881745-c879-4be0-be76-ea91574a3a0d req-8e9f1b2d-22d4-4026-a1fe-f764545858ad service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:20.533338 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-75881745-c879-4be0-be76-ea91574a3a0d req-8e9f1b2d-22d4-4026-a1fe-f764545858ad service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:20.533765 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-75881745-c879-4be0-be76-ea91574a3a0d req-8e9f1b2d-22d4-4026-a1fe-f764545858ad service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:20.544914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-75881745-c879-4be0-be76-ea91574a3a0d req-8e9f1b2d-22d4-4026-a1fe-f764545858ad service nova] Creating event network-changed:e3f9fb34-9b9b-415a-8e1a-224fd1f63698 for instance 59c39356-6319-4671-901b-e1a6067332ef on hv-cinder-85944 Sep 28 07:36:20.550024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-75881745-c879-4be0-be76-ea91574a3a0d req-8e9f1b2d-22d4-4026-a1fe-f764545858ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031055 Sep 28 07:36:20.550649 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 539/1107] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:21.053980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:21.054517 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:21.061016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:21.061754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:21.062352 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:21.063065 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:21.063514 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:21.063933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:21.088888 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a13aa372-03ca-441f-b4c7-0147079bc32d tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/ips" status: 200 len: 150 microversion: 2.1 time: 0.104299 Sep 28 07:36:21.089699 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 569/1108] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:36:20 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:22.447316 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e78e9bd1-5fba-4781-8783-94f73fd15b6f"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:22.449922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:22.456487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:22.456990 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:22.457457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:22.458153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:22.458607 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:22.459026 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:22.475801 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:22.705245 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-ef16960e-1eeb-4ed8-aaef-8cc8131ceaf0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "POST /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261832 Sep 28 07:36:22.705910 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 540/1109] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 07:36:22 2022] POST /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:30.348387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:30.348915 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:30.351925 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=37 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:30.357139 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:30.357621 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:30.358053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:30.358740 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:30.359191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:30.359613 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:30.364398 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:30.443150 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lazy-loading 'services' on Instance uuid a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:36:30.512203 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-13b3a2df-2fb4-4a20-a6bf-86c625faeac0 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments/e78e9bd1-5fba-4781-8783-94f73fd15b6f" status: 202 len: 0 microversion: 2.1 time: 0.167841 Sep 28 07:36:30.512820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 570/1110] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 07:36:30 2022] DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments/e78e9bd1-5fba-4781-8783-94f73fd15b6f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:36:30.522651 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:30.525070 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:30.527693 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:30.534540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:30.535677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:30.536301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:30.537046 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:30.537504 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:30.538475 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:30.572259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c6c8e203-6eb0-4e68-ba12-2289a849682c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054353 Sep 28 07:36:30.572860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 541/1111] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:36:30 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:31.585045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:31.587309 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:31.593447 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:31.593924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:31.594371 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:31.595054 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:31.595508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:31.595923 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:31.624427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-30ee755f-656e-4ab1-870c-2c493e2f0f6e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044480 Sep 28 07:36:31.624993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 571/1112] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 07:36:31 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 07:36:31.689641 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:31.690252 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:31.697632 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:31.698120 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:31.698558 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:31.699256 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:31.699712 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:31.700137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:31.725705 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:36:31.801855 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-97b2f3de-49e8-4bb6-bf55-28958592fa9b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 204 len: 0 microversion: 2.1 time: 0.115284 Sep 28 07:36:31.802725 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 542/1113] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:36:31 2022] DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:36:31.811604 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:31.812210 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:31.818887 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:31.819357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:31.819815 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:31.820496 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:31.820939 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:31.821380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:31.951032 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:31.958696 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a921270f-7241-4e9e-ba0d-8837f3a76ba7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1682 microversion: 2.1 time: 0.151382 Sep 28 07:36:31.959264 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 572/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:31 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:32.983218 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:32.983839 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:32.990315 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:32.990796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:32.991227 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:32.991914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:32.992365 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:32.992796 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:33.122384 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:33.130678 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-df3a08b5-f291-4ec8-9222-863e205318a7 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1682 microversion: 2.1 time: 0.151819 Sep 28 07:36:33.131411 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 543/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:32 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:34.155382 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:34.155993 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:34.162685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:34.163160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:34.163593 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:34.164289 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:34.164739 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:34.165197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:34.294615 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:34.303132 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8ef94444-a92b-4341-a829-3a146b272a80 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1682 microversion: 2.1 time: 0.151537 Sep 28 07:36:34.304357 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 573/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:34 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:34.652242 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-9c92d38c-90c9-4a78-b839-968ff19f4a49 req-23312161-9557-4cf9-9b86-cac0bb240cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68e86b2-b7b2-4203-bee8-fc0f0a4e5717", "name": "network-vif-deleted", "tag": "2121c7de-ea77-474c-8451-264d8e66b866"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:34.663200 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-9c92d38c-90c9-4a78-b839-968ff19f4a49 req-23312161-9557-4cf9-9b86-cac0bb240cdf service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:34.663969 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-9c92d38c-90c9-4a78-b839-968ff19f4a49 req-23312161-9557-4cf9-9b86-cac0bb240cdf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:34.664400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-9c92d38c-90c9-4a78-b839-968ff19f4a49 req-23312161-9557-4cf9-9b86-cac0bb240cdf service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:34.676775 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-9c92d38c-90c9-4a78-b839-968ff19f4a49 req-23312161-9557-4cf9-9b86-cac0bb240cdf service nova] Creating event network-vif-deleted:2121c7de-ea77-474c-8451-264d8e66b866 for instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 on hv-cinder-85944 Sep 28 07:36:34.682020 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-9c92d38c-90c9-4a78-b839-968ff19f4a49 req-23312161-9557-4cf9-9b86-cac0bb240cdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033559 Sep 28 07:36:34.682619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 544/1117] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:36:35.328226 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:35.328860 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:35.337099 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:35.337831 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:35.338669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:35.339573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:35.340220 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:35.340844 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:35.376005 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:35.376614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:35.377318 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:35.377831 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lazy-loading 'fault' on Instance uuid a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:36:35.421956 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44adfe9a391948f68dc747448546063e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a0b09b62ce47678fd542a0453c3d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:35.430029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f983a349-bddf-4e56-ad8e-c4a1df84ef0b tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 200 len: 1331 microversion: 2.1 time: 0.105907 Sep 28 07:36:35.430616 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 574/1118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:35 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:36.455453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:36.456184 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:36.462947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:36.463428 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:36.463860 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:36.464545 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:36.465017 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:36.465436 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:36.478396 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 HTTP/1.1 Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:36.480004 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:36.481751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'a68e86b2-b7b2-4203-bee8-fc0f0a4e5717'} Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:36.482891 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:36.484500 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:36.486007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:36.486007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3bb6e845-4822-4190-9629-c6dc3b06bc8e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 404 len: 111 microversion: 2.1 time: 0.030603 Sep 28 07:36:36.486007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 545/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:36 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:36.490162 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-464c72e5-7a06-4343-b3d7-aab93fc1f63c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '.version_select at 0x7fa861fe4550>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:36.509166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-464c72e5-7a06-4343-b3d7-aab93fc1f63c tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707708311" status: 202 len: 0 microversion: 2.1 time: 0.022894 Sep 28 07:36:36.509716 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 575/1120] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 07:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707708311 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:36:38.229267 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:38.229769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:38.236075 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:38.236563 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:38.237024 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:38.237707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:38.238240 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:38.238672 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:38.251792 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 HTTP/1.1 Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:38.253325 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.255491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'a68e86b2-b7b2-4203-bee8-fc0f0a4e5717'} Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:38.256498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.258138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.259889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:38.259889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-19185b23-b1be-4971-b40c-9150c86a6990 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 404 len: 111 microversion: 2.1 time: 0.030307 Sep 28 07:36:38.259889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 546/1121] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:36:38 2022] DELETE /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:38.263869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:38.264481 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a68e86b2-b7b2-4203-bee8-fc0f0a4e5717] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:38.272239 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:38.272715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:38.273176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:38.273859 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:38.274309 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:38.274728 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:38.287475 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 HTTP/1.1 Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:38.289133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.290763 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'a68e86b2-b7b2-4203-bee8-fc0f0a4e5717'} Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:38.292026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. Sep 28 07:36:38.293685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:38.295016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:38.295016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a924723c-41b9-4b2f-ae0a-decfde91ce13 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717" status: 404 len: 111 microversion: 2.1 time: 0.030447 Sep 28 07:36:38.295016 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 576/1122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:38 2022] GET /compute/v2.1/servers/a68e86b2-b7b2-4203-bee8-fc0f0a4e5717 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 07:36:39.427355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:39.427957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:39.434195 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.434666 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.435356 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.436048 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.436505 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.436951 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.451002 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 HTTP/1.1 Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:39.452590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.454265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'd8661396-29b3-42b5-9306-ebe79fe5f723'} Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:39.455187 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.456836 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.458962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:39.458962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3ffab462-845d-44a0-9042-2d382576ef8a tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 404 len: 111 microversion: 2.1 time: 0.030468 Sep 28 07:36:39.458962 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 547/1123] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:36:39 2022] DELETE /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:39.464228 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:39.464846 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: d8661396-29b3-42b5-9306-ebe79fe5f723] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:39.471133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.471607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.472037 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.472718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.473246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.473664 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.487014 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 HTTP/1.1 Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:39.488837 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.490508 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'd8661396-29b3-42b5-9306-ebe79fe5f723'} Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:39.491430 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. Sep 28 07:36:39.492937 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.494324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance d8661396-29b3-42b5-9306-ebe79fe5f723 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:39.494324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-552a7452-1b86-4097-bf18-9256e5c82fab tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723" status: 404 len: 111 microversion: 2.1 time: 0.029938 Sep 28 07:36:39.494324 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 577/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:39 2022] GET /compute/v2.1/servers/d8661396-29b3-42b5-9306-ebe79fe5f723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:39.498698 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:39.499201 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:39.505751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.506233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.506671 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.507368 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.507824 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.508258 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.521932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 HTTP/1.1 Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:39.523448 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.525056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '51bdb550-a2f4-43b5-a5b6-7faed7ef7be5'} Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:39.525986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.527481 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.529124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:39.529124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b0fea9c0-ca7c-4f4a-b4a6-85f779b3660e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 404 len: 111 microversion: 2.1 time: 0.029912 Sep 28 07:36:39.529124 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 548/1125] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:36:39 2022] DELETE /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:39.533152 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:39.533757 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:39.539569 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.540042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.540467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.541171 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:39.541616 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:39.542030 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:39.555157 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 HTTP/1.1 Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:39.556675 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.558327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '51bdb550-a2f4-43b5-a5b6-7faed7ef7be5'} Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:39.559266 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. Sep 28 07:36:39.561047 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:39.562499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance 51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:39.562499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a5582313-3635-45e9-93b8-b16a6f1f33e5 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5" status: 404 len: 111 microversion: 2.1 time: 0.028711 Sep 28 07:36:39.562499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 578/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:39 2022] GET /compute/v2.1/servers/51bdb550-a2f4-43b5-a5b6-7faed7ef7be5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:40.699587 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:40.700157 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:40.707191 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:40.707807 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:40.708246 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:40.709029 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:40.709441 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:40.709859 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:40.732042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed HTTP/1.1 Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:40.733644 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.735317 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'a6d19308-3fa5-46ed-b637-39d895095aed'} Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:40.736389 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.737967 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.739604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:40.739604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-799b4f22-dcf3-4df5-b70d-cae380f0dc3e tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 404 len: 111 microversion: 2.1 time: 0.043981 Sep 28 07:36:40.739604 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 549/1127] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:36:40 2022] DELETE /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:40.743586 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:40.744198 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] [instance: a6d19308-3fa5-46ed-b637-39d895095aed] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:40.750767 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:40.751243 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:40.751677 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:40.752358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:40.752808 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:40.753257 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:40.766577 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] HTTP exception thrown: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Request method failure captured: Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed HTTP/1.1 Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_gYaTxvkDASpDyzelAOHiQQ5Gw0UHmYjPm-C9snPrtHHFNfOR1s8wX0HgDmnfuQKg8jVKgaOfQeKErrzOnXRZrCOP5dZ_ZX2Ut2Sf98TfrVozvR92snm1UVgj24XGAh9jrC6TxxWLu39mkn0is6F9H3VOnlj2f9GshO3VYPU0Jx3yo Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:40.768118 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94a0b09b62ce47678fd542a0453c3d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94a0b09b62ce47678fd542a0453c3d17", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 94a0b09b62ce47678fd542a0453c3d17 Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-787268165 Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 44adfe9a391948f68dc747448546063e Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-AttachVolumeNegativeTest-787268165-project Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.770568 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'a6d19308-3fa5-46ed-b637-39d895095aed'} Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:40.771673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. Sep 28 07:36:40.773292 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:40.774906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] Returning 404 to user: Instance a6d19308-3fa5-46ed-b637-39d895095aed could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:40.774906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a46616a8-e3c3-4209-ad59-292843f2eea9 tempest-AttachVolumeNegativeTest-787268165 tempest-AttachVolumeNegativeTest-787268165-project] 10.222.0.52 "GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed" status: 404 len: 111 microversion: 2.1 time: 0.029804 Sep 28 07:36:40.774906 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 579/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:40 2022] GET /compute/v2.1/servers/a6d19308-3fa5-46ed-b637-39d895095aed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:45.223713 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c8a36dcf-b3ed-4f38-a2f1-955745cb3fa3 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Action: 'create', calling method: .version_select at 0x7fa861f818b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-815131190"}} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:45.513243 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c8a36dcf-b3ed-4f38-a2f1-955745cb3fa3 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.409854 Sep 28 07:36:45.513864 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 550/1129] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Sep 28 07:36:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 07:36:45.526665 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-a8135b19-3611-40ec-92c9-edd9908068f4 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa8621d5310>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:45.576737 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-a8135b19-3611-40ec-92c9-edd9908068f4 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 200 len: 344 microversion: 2.1 time: 0.053865 Sep 28 07:36:45.577342 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 580/1130] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:36:45 2022] GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:46.591814 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-c92476ce-903b-408a-843c-41bf5c39dc86 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa862371af0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:46.638905 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-c92476ce-903b-408a-843c-41bf5c39dc86 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 200 len: 345 microversion: 2.1 time: 0.051352 Sep 28 07:36:46.639464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 551/1131] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:36:46 2022] GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:46.652786 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0bcef3d4-9a74-4a35-95c6-dfd2265c6281 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Action: 'create', calling method: .version_select at 0x7fa86203a8b0>, body: {"snapshot": {"volume_id": "778e5a4e-71ca-42f9-a725-00cb3cef1d56", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-797942561"}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:46.809674 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0bcef3d4-9a74-4a35-95c6-dfd2265c6281 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.161072 Sep 28 07:36:46.810519 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 581/1132] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Sep 28 07:36:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:46.822572 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-19bbd844-538a-43c1-a8ea-a595ea4cd18d tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa861f73d30>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:46.852530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-19bbd844-538a-43c1-a8ea-a595ea4cd18d tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 286 microversion: 2.1 time: 0.033719 Sep 28 07:36:46.853133 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 552/1133] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:46 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:46.865176 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-2240ada6-6676-4a43-b907-92fbe1675729 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa865787280>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:46.895723 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-2240ada6-6676-4a43-b907-92fbe1675729 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035518 Sep 28 07:36:46.896293 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 582/1134] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Sep 28 07:36:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:36:46.907619 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-27fab5ad-c135-414a-bb6f-f5d87b51f4ee tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa86221d280>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:46.936989 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-27fab5ad-c135-414a-bb6f-f5d87b51f4ee tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 286 microversion: 2.1 time: 0.033270 Sep 28 07:36:46.937556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 553/1135] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:46 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:47.951102 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-53edda63-8939-48d0-bea7-4e698864e90a tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa86203a160>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:47.981146 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-53edda63-8939-48d0-bea7-4e698864e90a tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 286 microversion: 2.1 time: 0.034331 Sep 28 07:36:47.981736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 583/1136] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:47 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:48.994637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-17446ea2-07f4-423e-89f4-0605e86533a9 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa861f818b0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:49.025400 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-17446ea2-07f4-423e-89f4-0605e86533a9 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 286 microversion: 2.1 time: 0.035187 Sep 28 07:36:49.025957 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 554/1137] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:48 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:50.039215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b7b285e4-2c5f-4801-97c7-658225002af1 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa86207e940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:50.069182 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b7b285e4-2c5f-4801-97c7-658225002af1 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 286 microversion: 2.1 time: 0.034871 Sep 28 07:36:50.069741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 584/1138] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:50 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:51.078623 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:51.079399 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:51.083981 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-78fc430e-8892-4a09-8441-ee56e0361db2 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa861e923a0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:51.112306 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-78fc430e-8892-4a09-8441-ee56e0361db2 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 287 microversion: 2.1 time: 0.035052 Sep 28 07:36:51.112863 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 555/1139] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:51 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:51.121573 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:51.122327 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:36:51.126497 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5d5e3c37-b570-418e-8fb1-0901d6230512 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa8656d5d30>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:51.186868 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5d5e3c37-b570-418e-8fb1-0901d6230512 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 202 len: 0 microversion: 2.1 time: 0.066126 Sep 28 07:36:51.187852 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 585/1140] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Sep 28 07:36:51 2022] DELETE /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:36:51.196972 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-016668bf-9253-4297-820b-8d3d44aa1d5c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa861f73ee0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:51.227787 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-016668bf-9253-4297-820b-8d3d44aa1d5c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 200 len: 286 microversion: 2.1 time: 0.035861 Sep 28 07:36:51.228357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 556/1141] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:51 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:36:51.870188 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:36:51.870635 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:51.876736 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:51.877251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:51.877680 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:51.878355 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:51.878804 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:51.879222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:51.902428 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lazy-loading 'flavor' on Instance uuid b5f96d74-3ca1-41bf-95de-596b1b39b69d {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:36:51.980025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-840ca108-cd83-4c1b-adc2-c82620f38bca tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "POST /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d/action" status: 202 len: 0 microversion: 2.1 time: 0.113639 Sep 28 07:36:51.980601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 586/1142] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:36:51 2022] POST /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:36:51.988922 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:51.990357 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:51.997385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:51.997873 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:51.998285 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:51.999065 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:51.999491 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:51.999919 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:52.153956 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:52.162177 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2c132a71-bdcc-4913-a970-0a45c4f8e12f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.177094 Sep 28 07:36:52.162739 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 557/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:51 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:52.241235 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-968d1783-7ca6-49c7-8dd6-48555f56bebd tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa8657054c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:52.265936 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-968d1783-7ca6-49c7-8dd6-48555f56bebd tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] HTTP exception thrown: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-968d1783-7ca6-49c7-8dd6-48555f56bebd tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Request method failure captured: Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 HTTP/1.1 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_mNCkir97q3NheV-Z9uP3TnMuHvpdR8hO5aZMIoHFe9M54aAoNkMLfVINWIqzgZF4xtILjlYhBkqR7nwCjY8zB_8t4ZaEQW9YNZULVBz5XQKHQoUgkPRUm9kxcy5I8jaQWov10HCiCkwZFxB4IM_L5Hm9dV4ZjR_dljylerYVUSnA0 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:52.268286 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdabdd286f0b4aa083228d83ab2da629", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 7e1a7b864768445dbce9b2d2a6212fa1 Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '96d94e78-b53c-4da4-b343-bfa572112fe7'} Sep 28 07:36:52.270034 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. (HTTP 404) (Request-ID: req-25947f20-e8f0-4304-9f9d-9d145d6efab8) Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.271310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:36:52.272537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 28 07:36:52.274582 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-968d1783-7ca6-49c7-8dd6-48555f56bebd tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Returning 404 to user: Snapshot 96d94e78-b53c-4da4-b343-bfa572112fe7 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:52.276129 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-968d1783-7ca6-49c7-8dd6-48555f56bebd tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7" status: 404 len: 111 microversion: 2.1 time: 0.034022 Sep 28 07:36:52.277216 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 587/1144] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:36:52 2022] GET /compute/v2.1/os-snapshots/96d94e78-b53c-4da4-b343-bfa572112fe7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:52.278438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-31c83424-593c-4f34-acc3-0f184ad6e835 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa8620c4b80>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:52.337932 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-31c83424-593c-4f34-acc3-0f184ad6e835 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 202 len: 0 microversion: 2.1 time: 0.063197 Sep 28 07:36:52.338509 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 558/1145] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:36:52 2022] DELETE /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:36:52.347523 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7bf2854-51e3-4fea-b22f-b65c3776469f tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa862364940>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:52.396760 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7bf2854-51e3-4fea-b22f-b65c3776469f tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 200 len: 344 microversion: 2.1 time: 0.053978 Sep 28 07:36:52.397358 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 588/1146] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:36:52 2022] GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:36:53.186488 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:53.187097 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:53.193824 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:53.194304 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:53.194735 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:53.195417 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:53.195867 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:53.196286 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:53.325615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:53.333547 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-25ea341b-3af3-4068-85d1-1e898c516e02 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.151459 Sep 28 07:36:53.334119 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 559/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:53 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:53.412323 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91ed5a09-4d00-4ac7-8b8f-09f0123c7263 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa8621d54c0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:53.439965 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-91ed5a09-4d00-4ac7-8b8f-09f0123c7263 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] HTTP exception thrown: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91ed5a09-4d00-4ac7-8b8f-09f0123c7263 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Request method failure captured: Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 HTTP/1.1 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_mNCkir97q3NheV-Z9uP3TnMuHvpdR8hO5aZMIoHFe9M54aAoNkMLfVINWIqzgZF4xtILjlYhBkqR7nwCjY8zB_8t4ZaEQW9YNZULVBz5XQKHQoUgkPRUm9kxcy5I8jaQWov10HCiCkwZFxB4IM_L5Hm9dV4ZjR_dljylerYVUSnA0 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:53.442957 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdabdd286f0b4aa083228d83ab2da629", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 7e1a7b864768445dbce9b2d2a6212fa1 Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '778e5a4e-71ca-42f9-a725-00cb3cef1d56'} Sep 28 07:36:53.444599 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. (HTTP 404) (Request-ID: req-6d7347e3-e166-4ac3-bdbe-f701279388a9) Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.445609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:36:53.447070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 07:36:53.448393 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-91ed5a09-4d00-4ac7-8b8f-09f0123c7263 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Returning 404 to user: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-91ed5a09-4d00-4ac7-8b8f-09f0123c7263 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 404 len: 109 microversion: 2.1 time: 0.036575 Sep 28 07:36:53.449870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 589/1148] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:36:53 2022] GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:53.458493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5b686e77-c3e4-48d3-9927-94180394e77c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa861ea7ca0>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:53.485354 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-5b686e77-c3e4-48d3-9927-94180394e77c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] HTTP exception thrown: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5b686e77-c3e4-48d3-9927-94180394e77c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Request method failure captured: Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: DELETE /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 HTTP/1.1 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_mNCkir97q3NheV-Z9uP3TnMuHvpdR8hO5aZMIoHFe9M54aAoNkMLfVINWIqzgZF4xtILjlYhBkqR7nwCjY8zB_8t4ZaEQW9YNZULVBz5XQKHQoUgkPRUm9kxcy5I8jaQWov10HCiCkwZFxB4IM_L5Hm9dV4ZjR_dljylerYVUSnA0 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:36:53.487299 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdabdd286f0b4aa083228d83ab2da629", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 7e1a7b864768445dbce9b2d2a6212fa1 Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '778e5a4e-71ca-42f9-a725-00cb3cef1d56'} Sep 28 07:36:53.488939 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. (HTTP 404) (Request-ID: req-08612f23-089a-4759-beee-4d71e7d172b6) Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.490556 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 07:36:53.492083 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 07:36:53.493530 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5b686e77-c3e4-48d3-9927-94180394e77c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Returning 404 to user: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:53.494944 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5b686e77-c3e4-48d3-9927-94180394e77c tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 404 len: 109 microversion: 2.1 time: 0.034055 Sep 28 07:36:53.495958 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 560/1149] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 07:36:53 2022] DELETE /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:36:53.497594 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5660be95-6383-422d-bb4e-b03001ffb8c5 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Calling method '.version_select at 0x7fa862029700>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:53.525442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-5660be95-6383-422d-bb4e-b03001ffb8c5 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] HTTP exception thrown: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5660be95-6383-422d-bb4e-b03001ffb8c5 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Request method failure captured: Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 HTTP/1.1 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_mNCkir97q3NheV-Z9uP3TnMuHvpdR8hO5aZMIoHFe9M54aAoNkMLfVINWIqzgZF4xtILjlYhBkqR7nwCjY8zB_8t4ZaEQW9YNZULVBz5XQKHQoUgkPRUm9kxcy5I8jaQWov10HCiCkwZFxB4IM_L5Hm9dV4ZjR_dljylerYVUSnA0 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:36:53.527347 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdabdd286f0b4aa083228d83ab2da629"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdabdd286f0b4aa083228d83ab2da629", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: fdabdd286f0b4aa083228d83ab2da629 Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1920348149 Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 7e1a7b864768445dbce9b2d2a6212fa1 Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1920348149-project Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': '778e5a4e-71ca-42f9-a725-00cb3cef1d56'} Sep 28 07:36:53.528928 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. (HTTP 404) (Request-ID: req-1c5123e6-6020-4a91-a895-74aa839d70e1) Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.529960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 07:36:53.531377 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 07:36:53.532841 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-5660be95-6383-422d-bb4e-b03001ffb8c5 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] Returning 404 to user: Volume 778e5a4e-71ca-42f9-a725-00cb3cef1d56 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-5660be95-6383-422d-bb4e-b03001ffb8c5 tempest-VolumesSnapshotsTestJSON-1920348149 tempest-VolumesSnapshotsTestJSON-1920348149-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56" status: 404 len: 109 microversion: 2.1 time: 0.034941 Sep 28 07:36:53.534296 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 590/1150] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 07:36:53 2022] GET /compute/v2.1/os-volumes/778e5a4e-71ca-42f9-a725-00cb3cef1d56 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 07:36:54.356462 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:54.357121 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:54.363906 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:54.364586 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:54.365137 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:54.365904 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:54.366310 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:54.366736 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:54.505254 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:54.513069 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f8424fef-8b4f-4f31-aa64-9af7e8c41978 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.161040 Sep 28 07:36:54.513627 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 561/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:54 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:55.537527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:55.538251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:55.544185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:55.544658 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:55.545115 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:55.545793 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:55.546234 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:55.546651 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:55.687076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:55.699232 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-0356574e-14b7-4414-b650-12cd76a9ea9c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.166162 Sep 28 07:36:55.700189 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 591/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:55 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:56.722560 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:56.723265 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:56.730233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:56.730790 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:56.731228 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:56.731928 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:56.732382 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:56.732817 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:56.872222 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:56.880404 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bb218275-927a-4050-a6d8-8f1c5964a6d3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.161635 Sep 28 07:36:56.881132 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 562/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:56 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:57.904045 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:57.904770 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:57.913130 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:57.913606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:57.914029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:57.914816 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:57.915274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:57.915873 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:58.054715 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:58.063877 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d6b9c480-338c-4942-8151-ae948ef325a5 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.163579 Sep 28 07:36:58.065190 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 592/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:57 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:36:59.088618 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:36:59.089477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:36:59.099983 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:59.100485 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:59.100927 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:59.101678 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:36:59.102113 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:36:59.102544 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:36:59.237527 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:36:59.245356 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-1760840c-5191-490c-b869-0045fa24a57d tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.160720 Sep 28 07:36:59.245920 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 563/1155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:36:59 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:37:00.269452 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:00.270322 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:00.277055 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:00.277575 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:00.278053 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:00.278912 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:00.279511 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:00.279978 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:00.426219 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:00.434669 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f81fae46-8aa8-47b4-a8a0-7437747ba6ff tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.169112 Sep 28 07:37:00.435576 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 593/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:00 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:01.470114 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:01.470731 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:01.477993 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:01.478470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:01.478903 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:01.479588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:01.480030 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:01.480443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:01.617141 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:01.624968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-d1629f89-533a-4234-8a0e-32b6419b2832 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.158741 Sep 28 07:37:01.625534 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 564/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:01 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:02.652400 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:02.653038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:02.663482 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:02.663976 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:02.664410 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:02.665143 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:02.665598 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:02.666020 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:02.854423 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:02.863441 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-b81bb276-03c4-483e-8ab3-a50d31e08d42 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.214858 Sep 28 07:37:02.865097 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 594/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:02 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:03.887487 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:03.888126 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:03.894470 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:03.895459 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:03.896241 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:03.897103 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:03.897420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:03.897844 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:04.028985 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:04.037590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8f7ab3e5-fc29-49c7-965f-85567c245cee tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.153986 Sep 28 07:37:04.038940 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 565/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:03 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:05.062076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:05.062689 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:05.070466 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:05.070948 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:05.071380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:05.072070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:05.073233 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:05.073661 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:05.229205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:05.237567 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-bebedaf6-7368-4fa1-89f4-78f78e028f14 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.179784 Sep 28 07:37:05.238343 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 595/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:05 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:06.260829 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:06.261475 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:06.268185 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:06.268707 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:06.270377 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:06.271037 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:06.271677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:06.272115 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:06.412296 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:06.420385 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-e593c6ef-ff9e-4dc4-934f-ea296e1c8758 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1510 microversion: 2.1 time: 0.163177 Sep 28 07:37:06.421159 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 566/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:06 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:06.444402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:37:06.445252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:06.451601 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:06.452077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:06.452584 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:06.453415 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:06.453902 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:06.454483 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:06.484718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120452) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 07:37:06.549326 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-9b779918-2518-427b-9060-2affe2972ded tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "POST /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d/action" status: 202 len: 0 microversion: 2.1 time: 0.109965 Sep 28 07:37:06.550140 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 596/1162] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 07:37:06 2022] POST /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:37:06.557937 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:06.558648 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:06.564986 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:06.565537 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:06.566047 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:06.567339 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:06.567988 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:06.568346 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:06.711112 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:06.720209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6990d005-0f3a-4093-bdad-7392b9594eae tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1518 microversion: 2.1 time: 0.165891 Sep 28 07:37:06.720611 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 567/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:06 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 07:37:07.187392 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-240762a5-c3f7-437f-b93d-7bcfc8235ed5 req-17b9b599-2360-4343-a5ac-6e97fa26d04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "name": "network-vif-unplugged", "status": "completed", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:37:07.199081 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-240762a5-c3f7-437f-b93d-7bcfc8235ed5 req-17b9b599-2360-4343-a5ac-6e97fa26d04c service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:07.199777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-240762a5-c3f7-437f-b93d-7bcfc8235ed5 req-17b9b599-2360-4343-a5ac-6e97fa26d04c service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:07.200205 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-240762a5-c3f7-437f-b93d-7bcfc8235ed5 req-17b9b599-2360-4343-a5ac-6e97fa26d04c service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:07.212090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.compute.server_external_events [req-240762a5-c3f7-437f-b93d-7bcfc8235ed5 req-17b9b599-2360-4343-a5ac-6e97fa26d04c service nova] Unable to find a host for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d. Dropping event network-vif-unplugged {{(pid=120452) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 07:37:07.213251 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-240762a5-c3f7-437f-b93d-7bcfc8235ed5 req-17b9b599-2360-4343-a5ac-6e97fa26d04c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030044 Sep 28 07:37:07.214268 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 597/1164] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 07:37:07.746464 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:07.747262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:07.753719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:07.754737 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:07.755455 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:07.756655 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:07.757198 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:07.757689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:07.892590 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:07.901489 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-6d5ffe45-e546-4e5f-b6d4-ea7b0a947ada tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1520 microversion: 2.1 time: 0.159854 Sep 28 07:37:07.902059 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 568/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:07 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:08.927110 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:08.928353 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:08.935387 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:08.935882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:08.936320 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:08.937191 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:08.937820 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:08.938252 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:09.102520 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:09.110789 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-22e83a7b-31a9-4312-bf2b-fc43994b71c9 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.188886 Sep 28 07:37:09.111559 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 598/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:08 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:10.135383 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:10.135984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:10.142109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:10.142826 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:10.143259 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:10.143959 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:10.144413 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:10.144931 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:10.290430 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:10.298871 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-3341fba4-b8ed-43e3-ad4d-e43c840462c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.167211 Sep 28 07:37:10.299522 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 569/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:10 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:11.323534 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:11.324148 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:11.330530 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:11.331012 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:11.331443 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:11.332122 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:11.332571 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:11.333077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:11.470872 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:11.479469 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-ed49ccaf-2546-4997-954a-a0a8a507db26 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.159826 Sep 28 07:37:11.480048 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 599/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:11 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:12.503344 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:12.504155 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:12.510890 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:12.511367 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:12.511856 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:12.512600 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:12.513078 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:12.513539 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:12.656806 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:12.664768 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-5c201631-67d3-45bc-b0ea-384abbb78091 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.165322 Sep 28 07:37:12.665361 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 570/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:12 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:13.687857 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:13.688543 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:13.695777 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:13.696261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:13.696821 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:13.697579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:13.698027 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:13.698442 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:13.827274 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:13.835758 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d7369dab-409e-4886-93db-1ec7ee15e37c tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.152085 Sep 28 07:37:13.836321 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 600/1170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:13 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:14.859217 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:14.859820 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:14.867164 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:14.867637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:14.868063 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:14.868738 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:14.869210 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:14.869626 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:14.999529 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:15.008007 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a2236956-7943-45e8-a879-70d8c70dd819 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.152662 Sep 28 07:37:15.008563 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 571/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:14 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:16.031591 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:16.032217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:16.038768 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:16.039255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:16.039662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:16.040335 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:16.040778 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:16.041216 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:16.172843 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:16.181185 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-f0708cfd-a71f-41ab-b112-d0c2210f919f tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.153448 Sep 28 07:37:16.181741 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 601/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:16 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:17.204593 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:17.205233 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:17.212328 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:17.212813 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:17.213290 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:17.213987 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:17.214438 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:17.214861 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:17.304673 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-53fba47e-1004-4a02-bb17-ea76a24956b9 req-7b562c04-ee8e-4ca5-937a-ae5eb6c019fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "name": "network-vif-plugged", "status": "completed", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:37:17.315623 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-53fba47e-1004-4a02-bb17-ea76a24956b9 req-7b562c04-ee8e-4ca5-937a-ae5eb6c019fe service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:17.317179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-53fba47e-1004-4a02-bb17-ea76a24956b9 req-7b562c04-ee8e-4ca5-937a-ae5eb6c019fe service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:17.317179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-53fba47e-1004-4a02-bb17-ea76a24956b9 req-7b562c04-ee8e-4ca5-937a-ae5eb6c019fe service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:17.328484 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-53fba47e-1004-4a02-bb17-ea76a24956b9 req-7b562c04-ee8e-4ca5-937a-ae5eb6c019fe service nova] Creating event network-vif-plugged:1915b73a-7b44-4a13-af78-132204143dd2 for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d on hv-cinder-85944 Sep 28 07:37:17.333792 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-53fba47e-1004-4a02-bb17-ea76a24956b9 req-7b562c04-ee8e-4ca5-937a-ae5eb6c019fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033274 Sep 28 07:37:17.334574 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 602/1173] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:37:17.355437 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:17.363677 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-f54d0df3-8b1f-4add-be00-efae41e9ec85 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.162333 Sep 28 07:37:17.364637 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 572/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:17 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:18.390542 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:18.391245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:18.397554 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:18.398035 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:18.398464 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:18.399156 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:18.399607 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:18.400025 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:18.565385 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:18.573889 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-7521a8ea-7440-4a0d-b846-fe160ada22b2 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1576 microversion: 2.1 time: 0.188184 Sep 28 07:37:18.577304 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 603/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:18 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:37:19.597262 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:37:19.598719 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:37:19.605138 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:19.605615 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:19.606042 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:19.606728 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:37:19.607173 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:37:19.607588 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:37:19.827014 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:37:19.835533 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-8872a5c6-4991-460a-b7cb-d41d1ff80c68 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1563 microversion: 2.1 time: 0.241977 Sep 28 07:37:19.848972 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 573/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:37:19 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:00.403662 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:00.404217 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:00.404914 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-f4a3be7b-a688-4690-8b0b-a514e0545751 req-a3566c6b-ad57-4423-b3cb-3567faa09c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c39356-6319-4671-901b-e1a6067332ef", "tag": "e3f9fb34-9b9b-415a-8e1a-224fd1f63698"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:38:00.409999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=30 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:00.410527 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:00.410682 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=90 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:00.411477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 07:38:00.411622 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Wed Sep 28 07:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 28 07:38:00.412094 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:00.416261 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:00.417038 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:00.418074 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:00.420213 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:00.420882 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:00.421298 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f4a3be7b-a688-4690-8b0b-a514e0545751 req-a3566c6b-ad57-4423-b3cb-3567faa09c12 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:00.421822 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:00.421947 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f4a3be7b-a688-4690-8b0b-a514e0545751 req-a3566c6b-ad57-4423-b3cb-3567faa09c12 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:00.422257 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-f4a3be7b-a688-4690-8b0b-a514e0545751 req-a3566c6b-ad57-4423-b3cb-3567faa09c12 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:00.435467 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-f4a3be7b-a688-4690-8b0b-a514e0545751 req-a3566c6b-ad57-4423-b3cb-3567faa09c12 service nova] Creating event network-changed:e3f9fb34-9b9b-415a-8e1a-224fd1f63698 for instance 59c39356-6319-4671-901b-e1a6067332ef on hv-cinder-85944 Sep 28 07:38:00.440591 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-f4a3be7b-a688-4690-8b0b-a514e0545751 req-a3566c6b-ad57-4423-b3cb-3567faa09c12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039423 Sep 28 07:38:00.442113 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 574/1177] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 07:38:00.454250 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:38:00.547491 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8677d2f6-f62d-4776-98fd-374af44b1b83 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "DELETE /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 204 len: 0 microversion: 2.1 time: 0.147866 Sep 28 07:38:00.548380 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 604/1178] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:38:00 2022] DELETE /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:38:00.555323 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 07:38:00.555503 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Wed Sep 28 07:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef (ip 10.222.0.52) !!! Sep 28 07:38:00.560751 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:00.561571 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:00.570493 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:00.570984 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:00.571420 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:00.572180 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:00.572635 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:00.574016 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:00.719875 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:00.728457 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-aeecafc4-90d7-4938-8046-4e08431f5b7f tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1578 microversion: 2.1 time: 0.174208 Sep 28 07:38:00.729139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 575/1179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:00 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:01.754186 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:01.754917 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:01.761029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:01.761509 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:01.761945 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:01.762627 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:01.763077 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:01.763499 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:01.890988 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:01.899361 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-3b9b2224-16d5-4448-b144-fe6195f808bb tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1578 microversion: 2.1 time: 0.149579 Sep 28 07:38:01.899933 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 605/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:01 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:02.666999 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-3f38aefb-69d4-4ded-b30d-55acb26abab1 req-93614e55-5fe9-40bd-8230-b3cdcac02f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c39356-6319-4671-901b-e1a6067332ef", "name": "network-vif-deleted", "tag": "e3f9fb34-9b9b-415a-8e1a-224fd1f63698"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:38:02.678190 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3f38aefb-69d4-4ded-b30d-55acb26abab1 req-93614e55-5fe9-40bd-8230-b3cdcac02f9e service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:02.678660 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3f38aefb-69d4-4ded-b30d-55acb26abab1 req-93614e55-5fe9-40bd-8230-b3cdcac02f9e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:02.679084 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-3f38aefb-69d4-4ded-b30d-55acb26abab1 req-93614e55-5fe9-40bd-8230-b3cdcac02f9e service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:02.690689 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-3f38aefb-69d4-4ded-b30d-55acb26abab1 req-93614e55-5fe9-40bd-8230-b3cdcac02f9e service nova] Creating event network-vif-deleted:e3f9fb34-9b9b-415a-8e1a-224fd1f63698 for instance 59c39356-6319-4671-901b-e1a6067332ef on hv-cinder-85944 Sep 28 07:38:02.697273 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-3f38aefb-69d4-4ded-b30d-55acb26abab1 req-93614e55-5fe9-40bd-8230-b3cdcac02f9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Sep 28 07:38:02.698221 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 576/1181] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:38:02.923612 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:02.924222 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:02.931614 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:02.932167 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:02.932608 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:02.933343 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:02.934052 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:02.934478 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:02.975980 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:02.976558 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:02.977086 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:02.977609 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lazy-loading 'fault' on Instance uuid 59c39356-6319-4671-901b-e1a6067332ef {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:38:03.021787 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:03.031168 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-17721cdb-f529-4001-a878-f64643c664d7 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 200 len: 1231 microversion: 2.1 time: 0.111400 Sep 28 07:38:03.031754 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 606/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:02 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:04.055968 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:04.056663 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: 59c39356-6319-4671-901b-e1a6067332ef] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:04.063038 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:04.063513 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:04.063948 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:04.064629 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:04.065109 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:04.065525 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:04.078916 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] HTTP exception thrown: Instance 59c39356-6319-4671-901b-e1a6067332ef could not be found. Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Request method failure captured: Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef HTTP/1.1 Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_fyvE8bE60pVbwV2bJg8r-JJ1NyG_2jrggmfg-MAKtKaHtnDZL7vx_8tC8haN8yPjV1ga70WSmOhEL-SB-qsl5wqbajmluyDnNFRqmpaLmzZ-pAKT1owQVAa9bbb7Nl45AX-YXiAMuFq9Udza2fxFXCcwSpPG4HokE8jqLy8z-8Sfs Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:38:04.080482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfa33399f5994fb4a1ad804fa6e75f8b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 04cf365443b44d9d87338d95b5b0251b Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance 59c39356-6319-4671-901b-e1a6067332ef could not be found. Sep 28 07:38:04.082320 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': '59c39356-6319-4671-901b-e1a6067332ef'} Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c39356-6319-4671-901b-e1a6067332ef could not be found. Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:38:04.083517 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c39356-6319-4671-901b-e1a6067332ef could not be found. Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c39356-6319-4671-901b-e1a6067332ef could not be found. Sep 28 07:38:04.085266 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:04.087443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Returning 404 to user: Instance 59c39356-6319-4671-901b-e1a6067332ef could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:38:04.087443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-636e6128-a0c5-49d0-b77b-951c4b6639ec tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef" status: 404 len: 111 microversion: 2.1 time: 0.030700 Sep 28 07:38:04.087443 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 577/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:04 2022] GET /compute/v2.1/servers/59c39356-6319-4671-901b-e1a6067332ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:38:07.553018 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:07.558353 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-06a0e75d-fbe4-47b0-9359-cb1267c61217 req-b7db079a-fbeb-4371-80bf-8a85e9a656f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1499fdb-7b61-4c9e-81d3-09a649f4acab", "tag": "b8112591-d797-4e25-a5d4-e84683e0ddee"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:38:07.564863 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:07.572019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:07.572498 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-06a0e75d-fbe4-47b0-9359-cb1267c61217 req-b7db079a-fbeb-4371-80bf-8a85e9a656f4 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:07.572640 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:07.572930 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:07.573087 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-06a0e75d-fbe4-47b0-9359-cb1267c61217 req-b7db079a-fbeb-4371-80bf-8a85e9a656f4 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:07.573421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-06a0e75d-fbe4-47b0-9359-cb1267c61217 req-b7db079a-fbeb-4371-80bf-8a85e9a656f4 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:07.573766 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:07.574444 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:07.575070 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:07.586145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-06a0e75d-fbe4-47b0-9359-cb1267c61217 req-b7db079a-fbeb-4371-80bf-8a85e9a656f4 service nova] Creating event network-changed:b8112591-d797-4e25-a5d4-e84683e0ddee for instance f1499fdb-7b61-4c9e-81d3-09a649f4acab on hv-cinder-85944 Sep 28 07:38:07.591332 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-06a0e75d-fbe4-47b0-9359-cb1267c61217 req-b7db079a-fbeb-4371-80bf-8a85e9a656f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036435 Sep 28 07:38:07.592308 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 578/1184] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:38:07.606133 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Going to try to terminate instance {{(pid=120452) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:38:07.702606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-df1e6cbd-6f00-4bcb-9f6e-e0cbfbd7b89e tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 204 len: 0 microversion: 2.1 time: 0.153193 Sep 28 07:38:07.704310 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 607/1185] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:38:07 2022] DELETE /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:38:07.713416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:07.714567 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:07.721093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:07.722416 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:07.723093 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:07.724028 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:07.724694 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:07.725351 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:07.869943 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:07.877743 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-2dfe0218-dec4-4599-a07a-09d376e35079 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1578 microversion: 2.1 time: 0.169137 Sep 28 07:38:07.878352 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 579/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:07 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:08.902402 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:08.903162 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:08.909610 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:08.910090 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:08.910526 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:08.911215 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:08.911801 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:08.912224 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:09.044116 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:09.051795 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-4f863f0f-6274-4739-a5b1-c0cf51dc9a62 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1578 microversion: 2.1 time: 0.153649 Sep 28 07:38:09.053246 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 608/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:08 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:09.819341 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [req-23ba2163-08cb-49bc-b262-76c2c70dc9e5 req-3ae6f807-332c-42c9-bbfd-20ee0eb8b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1499fdb-7b61-4c9e-81d3-09a649f4acab", "name": "network-vif-deleted", "tag": "b8112591-d797-4e25-a5d4-e84683e0ddee"}]} {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:38:09.830975 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-23ba2163-08cb-49bc-b262-76c2c70dc9e5 req-3ae6f807-332c-42c9-bbfd-20ee0eb8b5f5 service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:09.831908 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-23ba2163-08cb-49bc-b262-76c2c70dc9e5 req-3ae6f807-332c-42c9-bbfd-20ee0eb8b5f5 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:09.832338 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [req-23ba2163-08cb-49bc-b262-76c2c70dc9e5 req-3ae6f807-332c-42c9-bbfd-20ee0eb8b5f5 service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:09.845113 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.compute.server_external_events [req-23ba2163-08cb-49bc-b262-76c2c70dc9e5 req-3ae6f807-332c-42c9-bbfd-20ee0eb8b5f5 service nova] Creating event network-vif-deleted:b8112591-d797-4e25-a5d4-e84683e0ddee for instance f1499fdb-7b61-4c9e-81d3-09a649f4acab on hv-cinder-85944 Sep 28 07:38:09.849873 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [req-23ba2163-08cb-49bc-b262-76c2c70dc9e5 req-3ae6f807-332c-42c9-bbfd-20ee0eb8b5f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Sep 28 07:38:09.850453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 580/1188] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:38:10.075562 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:10.076291 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:10.084201 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:10.084713 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:10.085271 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:10.085924 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:10.086374 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:10.086799 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:10.124254 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:10.124734 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:10.125427 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:10.125624 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.objects.instance [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lazy-loading 'fault' on Instance uuid f1499fdb-7b61-4c9e-81d3-09a649f4acab {{(pid=120452) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 07:38:10.176061 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04cf365443b44d9d87338d95b5b0251b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa33399f5994fb4a1ad804fa6e75f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:10.185521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-03d69357-15fb-4ae1-9c5e-1fe2ec89c5e1 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 200 len: 1231 microversion: 2.1 time: 0.113667 Sep 28 07:38:10.186281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 609/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:10 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:11.212601 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:11.213321 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: f1499fdb-7b61-4c9e-81d3-09a649f4acab] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:11.219362 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:11.219841 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:11.220269 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:11.220961 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:11.221421 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:11.221838 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:11.236850 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] HTTP exception thrown: Instance f1499fdb-7b61-4c9e-81d3-09a649f4acab could not be found. Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Request method failure captured: Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab HTTP/1.1 Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_fyvE8bE60pVbwV2bJg8r-JJ1NyG_2jrggmfg-MAKtKaHtnDZL7vx_8tC8haN8yPjV1ga70WSmOhEL-SB-qsl5wqbajmluyDnNFRqmpaLmzZ-pAKT1owQVAa9bbb7Nl45AX-YXiAMuFq9Udza2fxFXCcwSpPG4HokE8jqLy8z-8Sfs Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:38:11.238519 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfa33399f5994fb4a1ad804fa6e75f8b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 04cf365443b44d9d87338d95b5b0251b Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance f1499fdb-7b61-4c9e-81d3-09a649f4acab could not be found. Sep 28 07:38:11.241453 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'f1499fdb-7b61-4c9e-81d3-09a649f4acab'} Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1499fdb-7b61-4c9e-81d3-09a649f4acab could not be found. Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:38:11.242482 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1499fdb-7b61-4c9e-81d3-09a649f4acab could not be found. Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1499fdb-7b61-4c9e-81d3-09a649f4acab could not be found. Sep 28 07:38:11.244056 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.245540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Returning 404 to user: Instance f1499fdb-7b61-4c9e-81d3-09a649f4acab could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:38:11.245540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-a8139f7a-44b3-4e6f-b9c4-6833ce962651 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab" status: 404 len: 111 microversion: 2.1 time: 0.032912 Sep 28 07:38:11.245540 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 581/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:11 2022] GET /compute/v2.1/servers/f1499fdb-7b61-4c9e-81d3-09a649f4acab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:38:11.670869 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:11.671467 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:11.679160 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:11.679747 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:11.680197 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:11.681019 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:11.681465 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:11.681827 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:11.696870 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] HTTP exception thrown: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Request method failure captured: Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: DELETE /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 HTTP/1.1 Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_fyvE8bE60pVbwV2bJg8r-JJ1NyG_2jrggmfg-MAKtKaHtnDZL7vx_8tC8haN8yPjV1ga70WSmOhEL-SB-qsl5wqbajmluyDnNFRqmpaLmzZ-pAKT1owQVAa9bbb7Nl45AX-YXiAMuFq9Udza2fxFXCcwSpPG4HokE8jqLy8z-8Sfs Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:38:11.698579 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfa33399f5994fb4a1ad804fa6e75f8b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 04cf365443b44d9d87338d95b5b0251b Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.700212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'a4e62a15-55d5-43ca-a578-13300d349c53'} Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:38:11.701145 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.702521 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.705281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Returning 404 to user: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:38:11.705281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-55dc8e49-ef2e-4880-bc54-129ca983184a tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 404 len: 111 microversion: 2.1 time: 0.033992 Sep 28 07:38:11.705281 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 610/1191] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:38:11 2022] DELETE /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:38:11.708816 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:11.709440 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] [instance: a4e62a15-55d5-43ca-a578-13300d349c53] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:11.715301 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:11.715776 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:11.716204 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:11.716879 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:11.717355 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:11.717769 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:11.730681 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.wsgi [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] HTTP exception thrown: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Request method failure captured: Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: request: GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 HTTP/1.1 Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept: application/json Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Accept-Encoding: identity Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Connection: close Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Length: 0 Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Content-Type: application/json Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Host: 10.222.0.52 Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: Openstack-System-Scope: None Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: User-Agent: python-urllib3/1.26.12 Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Auth-Token: gAAAAABjM_fyvE8bE60pVbwV2bJg8r-JJ1NyG_2jrggmfg-MAKtKaHtnDZL7vx_8tC8haN8yPjV1ga70WSmOhEL-SB-qsl5wqbajmluyDnNFRqmpaLmzZ-pAKT1owQVAa9bbb7Nl45AX-YXiAMuFq9Udza2fxFXCcwSpPG4HokE8jqLy8z-8Sfs Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Id: None Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Domain-Name: None Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Identity-Status: Confirmed Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Is-Admin-Project: True Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Id: default Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Domain-Name: Default Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Project-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Role: reader,member Sep 28 07:38:11.732145 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Roles: reader,member Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfa33399f5994fb4a1ad804fa6e75f8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfa33399f5994fb4a1ad804fa6e75f8b", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Id: bfa33399f5994fb4a1ad804fa6e75f8b Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-Tenant-Name: tempest-TestVolumeBootPattern-1618017143 Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Id: default Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Domain-Name: Default Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Id: 04cf365443b44d9d87338d95b5b0251b Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: X-User-Name: tempest-TestVolumeBootPattern-1618017143-project Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: method: > Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: exception: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.733923 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: action_args: {'id': 'a4e62a15-55d5-43ca-a578-13300d349c53'} Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:38:11.734761 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. Sep 28 07:38:11.736094 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: ERROR nova.api.openstack.wsgi Sep 28 07:38:11.737477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Returning 404 to user: Instance a4e62a15-55d5-43ca-a578-13300d349c53 could not be found. {{(pid=120451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:38:11.737477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-464661b5-7ef4-46de-9eac-9201a5f94365 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53" status: 404 len: 111 microversion: 2.1 time: 0.028705 Sep 28 07:38:11.737477 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 582/1192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:11 2022] GET /compute/v2.1/servers/a4e62a15-55d5-43ca-a578-13300d349c53 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 07:38:13.030840 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-c2738117-6b01-48c9-aff9-c752903aa172 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] Calling method '.version_select at 0x7fa86207eaf0>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:13.050325 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-c2738117-6b01-48c9-aff9-c752903aa172 tempest-TestVolumeBootPattern-1618017143 tempest-TestVolumeBootPattern-1618017143-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1817965910" status: 202 len: 0 microversion: 2.1 time: 0.023312 Sep 28 07:38:13.051166 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 611/1193] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Sep 28 07:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1817965910 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 07:38:39.273406 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:39.276245 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:39.277422 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG dbcounter [-] [120452] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:39.281685 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-71333c06-c108-40ae-9671-041d6287ddf4 req-2addec45-c92e-4120-b320-68340145803b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:38:39.282632 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:39.284846 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_api:SELECT=18 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:39.285534 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG dbcounter [-] [120451] Writing DB stats nova_cell1:SELECT=26 {{(pid=120451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 07:38:39.299638 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-71333c06-c108-40ae-9671-041d6287ddf4 req-2addec45-c92e-4120-b320-68340145803b service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:39.300212 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-71333c06-c108-40ae-9671-041d6287ddf4 req-2addec45-c92e-4120-b320-68340145803b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:39.300679 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-71333c06-c108-40ae-9671-041d6287ddf4 req-2addec45-c92e-4120-b320-68340145803b service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:39.303343 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:39.303829 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:39.304852 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:39.306153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:39.306153 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:39.306451 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:39.314112 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-71333c06-c108-40ae-9671-041d6287ddf4 req-2addec45-c92e-4120-b320-68340145803b service nova] Creating event network-changed:1915b73a-7b44-4a13-af78-132204143dd2 for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d on hv-cinder-85944 Sep 28 07:38:39.319606 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-71333c06-c108-40ae-9671-041d6287ddf4 req-2addec45-c92e-4120-b320-68340145803b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044539 Sep 28 07:38:39.320506 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 612/1194] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:38:39.334880 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Going to try to terminate instance {{(pid=120451) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 07:38:39.422200 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-bb1228fe-ed3a-4830-978d-9ffcb57ad8fa tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 204 len: 0 microversion: 2.1 time: 0.152555 Sep 28 07:38:39.423082 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 583/1195] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 07:38:39 2022] DELETE /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 07:38:39.431971 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:39.432671 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:39.440602 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:39.441111 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:39.441546 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:39.442237 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:39.442718 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:39.443179 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:39.580603 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.policy [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120452) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:39.589175 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-8a4f2f03-43cc-4b7f-862a-4dd65f96603a tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.161419 Sep 28 07:38:39.589744 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 613/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:39 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:40.615209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:40.616068 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:40.622100 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:40.622581 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:40.623011 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:40.623695 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:40.624139 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:40.624553 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:40.788617 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:40.796255 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b34e1436-b5a6-4d01-b81d-e2ec2ff97392 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1569 microversion: 2.1 time: 0.185996 Sep 28 07:38:40.796842 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 584/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:40 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:41.629916 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [req-aec1df59-2fbd-42a4-a5f5-2d8e1a2616bd req-e824df22-7e55-4afa-a18e-a93838134a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f96d74-3ca1-41bf-95de-596b1b39b69d", "name": "network-vif-deleted", "tag": "1915b73a-7b44-4a13-af78-132204143dd2"}]} {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 07:38:41.641042 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aec1df59-2fbd-42a4-a5f5-2d8e1a2616bd req-e824df22-7e55-4afa-a18e-a93838134a5d service nova] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:41.641541 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aec1df59-2fbd-42a4-a5f5-2d8e1a2616bd req-e824df22-7e55-4afa-a18e-a93838134a5d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:41.641975 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [req-aec1df59-2fbd-42a4-a5f5-2d8e1a2616bd req-e824df22-7e55-4afa-a18e-a93838134a5d service nova] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:41.654297 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.compute.server_external_events [req-aec1df59-2fbd-42a4-a5f5-2d8e1a2616bd req-e824df22-7e55-4afa-a18e-a93838134a5d service nova] Creating event network-vif-deleted:1915b73a-7b44-4a13-af78-132204143dd2 for instance b5f96d74-3ca1-41bf-95de-596b1b39b69d on hv-cinder-85944 Sep 28 07:38:41.659285 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [req-aec1df59-2fbd-42a4-a5f5-2d8e1a2616bd req-e824df22-7e55-4afa-a18e-a93838134a5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033181 Sep 28 07:38:41.659954 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 614/1198] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 07:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 07:38:41.823000 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:41.823559 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.compute.api [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120451) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:41.829720 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:41.830209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:41.830642 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:41.831330 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:41.831774 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:41.832184 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG oslo_concurrency.lockutils [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:41.894580 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.policy [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880d5318ebb145fbb3cd8b02814903f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ec4a1f0d60440c86413595a8eb16ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120451) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 07:38:41.903381 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-b2cdba48-aeb8-450e-9099-a1a766def6c3 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 200 len: 1219 microversion: 2.1 time: 0.084250 Sep 28 07:38:41.904209 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 585/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:41 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 07:38:42.928537 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '>' {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:42.929255 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.compute.api [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] [instance: b5f96d74-3ca1-41bf-95de-596b1b39b69d] Fetching instance by UUID {{(pid=120452) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 07:38:42.935972 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:42.936435 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:42.936866 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:42.937578 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Acquiring lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 07:38:42.938026 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 07:38:42.938446 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG oslo_concurrency.lockutils [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Lock "48cd990f-efc9-4822-a4b6-c05c4d52ec78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 07:38:42.951401 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.wsgi [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] HTTP exception thrown: Instance b5f96d74-3ca1-41bf-95de-596b1b39b69d could not be found. Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Request method failure captured: Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: request: GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d HTTP/1.1 Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept: application/json Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Accept-Encoding: identity Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Connection: close Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Length: 0 Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Content-Type: application/json Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Host: 10.222.0.52 Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: Openstack-System-Scope: None Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: User-Agent: python-urllib3/1.26.12 Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Auth-Token: gAAAAABjM_jWHTU7_naJVBB5lbA3qMsmK1EbBQix6dCdqN5rTn0y1J1aIQPRLYuvU8p5GAKY4U9oHQaE5AyPzcSgVWGlmZBAQ_Dwwh9nL2zkoku-zuj5tWg-yoDtX0cRdYXjaMflmU99QddhEJjut0qouDOJWFAJkUookjGHBflP1V0cWF-qudk Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Id: None Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Domain-Name: None Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Identity-Status: Confirmed Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Is-Admin-Project: True Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Id: default Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Domain-Name: Default Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Id: 39ec4a1f0d60440c86413595a8eb16ae Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Project-Name: tempest-TestShelveInstance-623903727 Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Role: reader,member Sep 28 07:38:42.953076 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Roles: reader,member Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39ec4a1f0d60440c86413595a8eb16ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39ec4a1f0d60440c86413595a8eb16ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39ec4a1f0d60440c86413595a8eb16ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39ec4a1f0d60440c86413595a8eb16ae", "adminURL": "http://10.222.0.52:8080"}]}] Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant: tempest-TestShelveInstance-623903727 Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Id: 39ec4a1f0d60440c86413595a8eb16ae Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-Tenant-Name: tempest-TestShelveInstance-623903727 Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User: tempest-TestShelveInstance-623903727-project Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Id: default Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Domain-Name: Default Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Id: 880d5318ebb145fbb3cd8b02814903f2 Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: X-User-Name: tempest-TestShelveInstance-623903727-project Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: method: > Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: exception: Instance b5f96d74-3ca1-41bf-95de-596b1b39b69d could not be found. Sep 28 07:38:42.954960 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: action_args: {'id': 'b5f96d74-3ca1-41bf-95de-596b1b39b69d'} Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: {{(pid=120452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f96d74-3ca1-41bf-95de-596b1b39b69d could not be found. Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 07:38:42.956029 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f96d74-3ca1-41bf-95de-596b1b39b69d could not be found. Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f96d74-3ca1-41bf-95de-596b1b39b69d could not be found. Sep 28 07:38:42.957894 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: ERROR nova.api.openstack.wsgi Sep 28 07:38:42.959492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: DEBUG nova.api.openstack.wsgi [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Returning 404 to user: Instance b5f96d74-3ca1-41bf-95de-596b1b39b69d could not be found. {{(pid=120452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 07:38:42.959492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: INFO nova.api.openstack.requestlog [None req-d64de36f-91be-4779-b90b-0bc5812c6bb1 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d" status: 404 len: 111 microversion: 2.1 time: 0.031261 Sep 28 07:38:42.959492 dv-cinder-859447-1-iscsi devstack@n-api.service[120452]: [pid: 120452|app: 0|req: 615/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 07:38:42 2022] GET /compute/v2.1/servers/b5f96d74-3ca1-41bf-95de-596b1b39b69d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 07:38:43.113795 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: DEBUG nova.api.openstack.wsgi [None req-eb446c38-4326-4aee-9a92-cbd9c76d89b7 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] Calling method '.version_select at 0x7fa861f81040>' {{(pid=120451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 07:38:43.136889 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: INFO nova.api.openstack.requestlog [None req-eb446c38-4326-4aee-9a92-cbd9c76d89b7 tempest-TestShelveInstance-623903727 tempest-TestShelveInstance-623903727-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-957731964" status: 202 len: 0 microversion: 2.1 time: 0.026713 Sep 28 07:38:43.143773 dv-cinder-859447-1-iscsi devstack@n-api.service[120451]: [pid: 120451|app: 0|req: 586/1201] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 07:38:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-957731964 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)